-- Logs begin at Wed 2022-08-24 04:05:35 UTC, end at Wed 2022-08-24 05:28:03 UTC. -- Aug 24 04:50:39.757200 dv-cinder-854265-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:50:39.765805 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:50:39 2022] *** Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: nodename: dv-cinder-854265-1-iscsi Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: machine: x86_64 Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: clock source: unix Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: pcre jit disabled Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: detected number of CPU cores: 4 Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: current working directory: / Aug 24 04:50:39.767801 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: your processes number limit is 47680 Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: your memory page size is 4096 bytes Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: detected max file descriptor number: 2048 Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: lock engine: pthread robust mutexes Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: thunder lock: enabled Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:50:39.768502 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:50:39.807938 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: Python main interpreter initialized at 0x55f98d5219c0 Aug 24 04:50:39.807938 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: python threads support enabled Aug 24 04:50:39.807938 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: your server socket listen backlog is limited to 100 connections Aug 24 04:50:39.807938 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:50:39.808281 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:50:39.808363 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: *** Operational MODE: preforking *** Aug 24 04:50:39.808597 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:50:39.808597 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: spawned uWSGI master process (pid: 106838) Aug 24 04:50:39.808781 dv-cinder-854265-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:50:39.810453 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: spawned uWSGI worker 1 (pid: 106839, cores: 1) Aug 24 04:50:39.810453 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: spawned uWSGI worker 2 (pid: 106840, cores: 1) Aug 24 04:50:39.810453 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:50:40.473554 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:50:40.474991 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:50:41.567196 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:50:41.567196 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: from cryptography.utils import int_from_bytes Aug 24 04:50:41.567923 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:50:41.567923 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: from cryptography.utils import int_from_bytes Aug 24 04:50:41.569251 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:50:41.569251 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: from cryptography.utils import int_from_bytes Aug 24 04:50:41.569669 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:50:41.569669 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: from cryptography.utils import int_from_bytes Aug 24 04:50:44.071936 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:50:44.072506 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:50:44.072712 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:50:44.072878 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:50:44.073245 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:50:44.073340 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:50:44.073437 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:50:44.073683 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:50:44.073785 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.073991 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.074088 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:50:44.074286 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:50:44.074441 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.074612 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.074712 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.074939 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075056 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075275 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075371 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075594 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075688 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.075910 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076028 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076234 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076321 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076496 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076599 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076813 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.076915 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077134 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-1-iscsi {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077221 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077426 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077513 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077743 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.077842 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078052 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078143 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-1-iscsi {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078370 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078462 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078673 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078765 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.078987 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079103 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079313 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079416 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079630 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079807 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.079956 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.080240 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.080346 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.080545 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.080763 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.080882 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.081163 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.081921 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082033 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082248 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082411 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082571 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082655 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082887 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.082994 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083219 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083374 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083541 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083632 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083850 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.083955 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084172 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084267 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-1-iscsi {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084487 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084601 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084844 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.084946 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-1-iscsi {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085157 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085264 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085497 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085591 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085815 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.085968 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086155 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086287 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086485 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086602 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086802 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.086924 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087136 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087231 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087462 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087557 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087774 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.087872 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088091 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088184 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088410 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088509 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088712 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.088801 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089020 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089108 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089328 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089418 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089642 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089761 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.089943 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090040 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090249 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090342 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090500 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090587 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090807 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.090892 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091111 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091218 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091427 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091515 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091754 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.091840 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092071 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092171 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092322 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092434 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092635 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092727 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092890 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.092988 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093213 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093300 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093536 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093636 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093840 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.093933 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094146 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094237 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094452 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094546 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094758 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.094850 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095083 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095173 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095390 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095490 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095697 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.095781 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096008 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096094 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096325 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096422 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096663 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096755 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.096998 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.097147 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.097396 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.097583 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.097711 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.097798 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098022 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098108 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098361 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098457 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098674 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098769 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.098982 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099097 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099322 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099416 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099641 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099727 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.099948 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100034 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100256 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100343 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100561 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100648 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100870 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.100956 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101181 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101269 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101490 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101741 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.101839 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102039 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102125 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102344 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102431 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102648 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102750 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.102950 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103083 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103280 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103373 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103585 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103680 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103884 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.103977 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104187 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104281 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104488 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104582 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104790 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.104876 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105094 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105179 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105398 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105485 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105700 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.105794 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106004 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106097 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106308 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106397 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106613 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106706 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.106923 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107046 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107259 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107347 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107560 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107645 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107864 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.107957 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108167 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108255 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108470 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108566 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.108872 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109077 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109169 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109381 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109474 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109690 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109780 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.109995 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110088 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110301 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110388 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110613 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110704 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.110914 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111004 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111242 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111340 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111554 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111638 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111850 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.111936 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.112156 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.112250 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.112489 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.112707 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.112872 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113028 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113143 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113325 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113421 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113632 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113720 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.113937 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114025 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114242 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114336 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114548 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114635 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114853 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.114946 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115178 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115276 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115478 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.115863 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116101 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116186 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116408 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116496 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116716 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.116809 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117021 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117114 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117327 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117412 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117650 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:50:44.117745 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.117979 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118073 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118318 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118414 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118629 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118714 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.118961 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119109 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119317 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119443 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119638 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119725 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.119952 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120040 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120265 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120350 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120585 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120670 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120895 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.120987 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121208 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121302 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121521 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121606 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121836 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.121922 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122154 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122246 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122472 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122567 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122804 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.122892 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123170 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123262 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123496 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123584 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123817 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.123906 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124133 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124219 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124454 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124548 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124771 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.124872 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125083 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125177 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125396 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125490 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125739 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.125826 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126051 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126136 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126377 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126478 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126701 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.126804 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127042 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127145 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127346 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127441 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127659 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.127746 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.128494 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.128652 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.128826 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.128996 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129165 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129264 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129476 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129570 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129788 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.129883 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130102 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130187 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130413 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130506 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130724 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.130812 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131052 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131375 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131473 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131692 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.131778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132007 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132094 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132320 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132406 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132633 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132719 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.132946 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133050 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133284 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133369 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133552 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133637 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133858 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.133955 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134163 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134254 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134464 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134550 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134769 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.134853 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135090 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135196 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135411 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135498 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135733 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.135818 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136036 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136360 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136444 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136663 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136747 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.136975 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137102 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137290 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137385 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137596 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137682 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137902 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.137996 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138209 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138296 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138517 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138609 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138823 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.138910 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139154 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139244 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139468 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139596 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139775 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.139870 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140083 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140179 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140386 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140473 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140690 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.140778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141002 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141087 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141312 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141405 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141622 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141709 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.141933 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142019 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142246 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142339 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142564 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142652 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142874 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.142958 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.143211 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.143310 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144161 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144312 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144512 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144670 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144819 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.144952 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145116 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145208 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145440 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145535 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145756 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.145844 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146060 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146147 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146372 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146465 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146677 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146774 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.146982 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147140 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147318 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147440 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147632 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147735 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.147934 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148025 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148240 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148338 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148544 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148636 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.148945 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149150 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149248 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149454 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149543 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149765 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.149865 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150065 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150165 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150368 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150472 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150672 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150760 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.150977 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.151101 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.151350 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.151448 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.151664 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.151753 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152005 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152103 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152325 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152422 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152646 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152735 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.152959 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153050 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153274 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153362 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153582 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153669 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153895 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.153985 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154208 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154297 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154517 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154619 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154832 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.154938 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155179 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155287 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155498 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155589 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155823 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.155914 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156142 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156245 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156548 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156770 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.156858 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157073 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157160 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157390 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157501 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157712 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.157802 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158041 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158130 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158357 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158464 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158678 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158767 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.158989 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.159095 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.159394 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.159503 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160028 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160321 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160457 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160541 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160621 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160711 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160793 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.160879 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161085 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161199 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161397 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161528 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161713 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.161844 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162026 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162169 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162347 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162485 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162656 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162812 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.162973 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163151 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163302 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163478 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163620 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163787 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.163946 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164109 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164276 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164442 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164587 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164779 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.164883 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165099 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165201 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165413 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165502 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165739 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.165836 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166054 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166144 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166366 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166455 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166676 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166763 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.166983 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167095 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167317 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167421 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167636 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167737 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.167944 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168035 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168249 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168346 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168561 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168661 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168866 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.168954 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169170 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169259 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169473 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169579 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169781 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.169885 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.170089 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.170175 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.172854 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.172986 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173064 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173132 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173132 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173249 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173249 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173456 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173528 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173601 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173673 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173740 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173812 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173878 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.173942 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174013 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174079 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174152 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174218 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174284 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174348 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174413 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174484 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174564 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174631 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174697 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174761 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174826 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174890 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.174970 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.175069 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.175348 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.175441 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.175687 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.175778 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176168 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176274 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176366 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176463 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176545 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176634 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176868 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.176965 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177185 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177275 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177501 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177697 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177808 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.177896 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178120 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178218 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178430 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178532 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178740 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.178828 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179075 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179195 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179390 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179505 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179696 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.179791 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.180008 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.180103 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.180318 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.180448 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.180634 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.181154 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.181251 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.181489 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.181782 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.181886 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182113 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182217 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182432 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182534 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182750 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.182847 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183101 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183197 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183429 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183537 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183763 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.183867 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184068 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184177 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184377 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184482 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184685 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184788 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.184992 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.185101 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.185305 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.185416 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.185611 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.185740 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187110 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187209 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187279 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187343 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187407 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187478 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187638 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187732 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187805 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187878 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.187956 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188023 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188087 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188151 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188214 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188284 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.188359 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.190241 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.191692 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.191807 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.191903 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.191996 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192077 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192155 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192232 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192309 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192392 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192484 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192569 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192648 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192725 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192814 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192907 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.192907 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193058 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193137 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193214 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193291 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193377 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193457 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193534 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193611 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193687 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193763 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.193927 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194004 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194089 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194167 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194339 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194505 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194659 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194783 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.194968 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195118 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195312 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195422 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195628 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195735 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.195937 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196042 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196255 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196353 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196567 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196661 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196882 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.196970 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197198 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197284 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197503 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197591 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197815 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.197902 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198120 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198206 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198421 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198515 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198726 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.198822 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199048 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199138 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199353 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199451 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199656 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199742 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.199966 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200051 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200266 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200360 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200578 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200670 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200878 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.200963 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201184 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201291 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201485 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201578 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201791 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.201876 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202092 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202181 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202484 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202702 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.202787 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203009 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203115 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203333 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203430 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203636 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203722 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.203945 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204031 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204244 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204329 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204546 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204633 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204849 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.204935 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205154 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205241 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205467 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205767 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.205852 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.206702 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.206917 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207091 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207327 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207492 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207642 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207794 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.207932 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208022 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208237 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208326 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208552 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208640 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208873 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.208969 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209167 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209269 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209473 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209773 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.209875 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210077 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210162 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210475 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210696 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210792 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.210999 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211109 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211326 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211416 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211628 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211724 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.211958 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212051 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212267 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212360 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212604 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212699 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.212918 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213004 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213233 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213319 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213543 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213637 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213852 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.213940 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214162 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214248 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214464 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214552 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214770 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.214902 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215107 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215209 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215421 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215517 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215724 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.215811 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216027 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216122 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216331 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216418 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216643 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216729 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.216954 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217051 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217271 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217358 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217588 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217673 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.217910 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218007 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218215 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218310 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218524 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218617 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218834 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.218928 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219169 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219269 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219479 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219564 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219790 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.219888 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220098 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220186 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220410 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220499 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220718 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.220817 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221029 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221121 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221335 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221420 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221673 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221824 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.221964 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222091 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222282 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222424 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222571 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222720 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222867 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.222970 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223221 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223312 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223525 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223613 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223827 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.223921 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224140 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224237 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224447 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224536 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224760 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.224848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225067 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225225 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225494 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225581 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225807 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.225894 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226121 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226220 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226427 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226514 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226737 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.226823 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227068 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227173 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227385 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227480 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227689 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227776 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.227998 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.228092 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.228404 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.228500 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.228715 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.228809 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229024 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229113 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229327 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229414 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229629 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229723 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.229934 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230021 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230241 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230328 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230545 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230630 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.230936 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231173 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231272 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231480 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231566 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231786 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.231875 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232096 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232181 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232418 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232515 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232804 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.232889 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233108 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233203 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233428 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233523 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233819 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.233906 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234131 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234218 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234441 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234535 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234759 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.234846 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235109 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235198 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235415 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235509 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235730 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.235835 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236045 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236166 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236359 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236464 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236677 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.236989 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237096 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237334 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237439 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237639 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237730 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.237952 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238141 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238279 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238477 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238605 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238794 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.238922 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.239145 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.239274 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.239560 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.239690 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.239883 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240015 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240330 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240520 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240654 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240846 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.240981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241153 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241288 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241462 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241598 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241777 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.241914 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242083 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242224 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242398 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242534 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242698 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.242859 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243006 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243202 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243341 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243519 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243653 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243833 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.243965 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244146 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244270 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244452 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244575 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244759 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.244896 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245102 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245192 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245390 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245510 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245712 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.245825 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246028 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246148 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246355 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246453 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246679 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246769 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.246986 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247100 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247339 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247500 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247643 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247794 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.247949 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248087 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248257 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248394 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248563 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248715 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.248887 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249064 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249209 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249340 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249507 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249658 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249837 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.249972 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250149 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250284 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250585 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250702 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250797 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.250890 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251137 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251232 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251463 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251785 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.251875 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252102 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252190 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252408 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252499 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252716 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.252808 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.253565 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.253667 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.253874 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254028 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254328 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254418 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254638 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254727 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.254945 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255058 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255277 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255365 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255579 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255681 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255882 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.255979 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256291 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256499 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256597 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256816 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.256906 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257212 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257432 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257732 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.257887 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258023 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258155 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258362 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258513 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258675 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.258820 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259052 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259139 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259328 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259418 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259647 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259743 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.259964 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260050 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260277 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260364 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260592 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260722 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260904 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.260991 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261220 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261309 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261534 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261620 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261842 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.261929 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262153 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262241 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262462 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262557 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262776 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.262871 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.263119 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.263324 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.263646 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.263735 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.263962 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264057 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264275 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264362 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264590 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264683 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.264906 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265005 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265217 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265304 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265530 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265619 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265838 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.265934 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266151 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266239 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266464 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266570 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.266868 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267118 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267208 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267445 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267546 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267768 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.267863 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.268085 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.268171 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.268400 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.268609 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.269406 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.269566 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.269709 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.269894 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270066 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270227 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270384 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270588 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270694 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.270911 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271037 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271340 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271572 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271673 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271892 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.271989 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.272226 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.272324 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.272521 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.272616 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.272833 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273061 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273149 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273228 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273438 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273525 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273750 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.273860 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274060 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274154 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274374 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274469 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274690 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.274779 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275012 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275129 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275347 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275435 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275663 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275755 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.275980 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.276068 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.276293 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.276505 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.276626 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.276824 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277121 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277221 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277447 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277559 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277775 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.277874 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278092 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278192 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278411 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278525 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278736 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.278842 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279060 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279161 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279373 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279472 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279686 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279777 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.279991 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280077 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280291 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280378 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280605 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280691 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280911 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.280998 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281212 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281300 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281532 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281620 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281836 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.281923 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.282160 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.282359 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.282456 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.282707 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.282989 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.283181 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.283368 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.283459 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.283688 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.283783 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284019 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284137 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284423 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284568 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284804 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.284930 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285108 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285231 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285415 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285563 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285732 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.285875 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286043 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286184 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286347 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286504 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286654 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286822 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.286966 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287155 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287302 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287463 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287605 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287780 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.287918 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288095 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288222 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288401 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288546 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288722 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.288852 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289030 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289165 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289357 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289470 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289665 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289782 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.289973 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290086 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290280 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290594 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290691 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290903 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.290991 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291238 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291335 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291546 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291643 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291852 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.291947 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292167 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292255 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292474 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292778 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.292867 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293082 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293177 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293383 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293470 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293690 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293777 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.293994 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294081 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294385 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294622 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294710 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.294927 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295072 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295272 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295359 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295586 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295673 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.295896 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296005 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296220 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296306 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296534 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296622 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.296851 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.297057 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.297197 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.297391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.297520 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.297712 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298044 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298139 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298374 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298470 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298682 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298770 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.298992 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.299145 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.299320 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.299408 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.299644 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.300246 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.300616 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.300776 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.300916 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301036 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301237 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301332 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301555 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301644 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301870 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.301958 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302183 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302279 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302497 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302584 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302810 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.302896 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303146 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303318 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303463 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303550 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303775 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.303861 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304084 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304180 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304396 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304491 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304709 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.304795 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305023 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305114 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305338 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305426 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305652 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.305740 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306237 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306333 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306557 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306645 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306878 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.306999 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307216 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307314 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307529 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307620 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307841 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.307931 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308153 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308244 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308466 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308554 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.308876 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309092 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309191 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309395 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309485 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309736 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.309835 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310052 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310143 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310365 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310514 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310722 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.310868 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311048 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311142 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311364 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311461 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311688 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.311778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312001 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312090 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312324 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312412 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312638 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312727 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.312949 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313036 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313276 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313363 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313592 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313680 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.313914 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314000 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314221 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314322 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314526 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314614 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314829 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.314916 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.315173 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.315278 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.316170 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.316310 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.316581 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.316750 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.316898 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317058 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317223 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317366 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317539 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317684 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317850 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.317994 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318161 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318303 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318477 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318612 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318786 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.318919 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319120 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319255 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319435 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319566 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319745 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.319870 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320059 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320175 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320366 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320493 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320674 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320764 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.320983 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321124 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321289 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321598 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321694 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.321901 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322035 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322229 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322333 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322514 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322604 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322820 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.322908 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323147 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323250 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323456 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323544 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323760 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.323848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324092 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324192 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324398 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324484 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324719 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.324807 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325042 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325139 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325355 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325449 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325680 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325768 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.325996 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326093 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326320 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326408 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326642 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326730 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.326962 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327089 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327304 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327392 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327615 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327702 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.327930 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328023 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328244 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328331 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328558 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328657 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328875 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.328964 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329198 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329285 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329512 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329651 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329833 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.329927 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330154 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330242 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330461 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330556 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330785 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.330880 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.331678 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.331836 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332004 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332156 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332324 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332420 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332642 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332739 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.332980 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333132 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333296 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333420 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333607 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333702 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.333923 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334012 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334234 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334322 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334549 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334645 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334865 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.334951 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335206 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335305 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335525 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335621 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335847 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.335936 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336159 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336253 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336487 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336584 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336813 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.336907 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337128 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337254 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337470 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337571 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337773 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.337868 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338103 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338189 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338419 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338508 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338732 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.338819 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.339062 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.339165 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.339305 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:50:44.339419 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.339739 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.340049 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:50:44.340298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:50:44.495313 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO dbcounter [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Registered counter for database nova_api Aug 24 04:50:44.495571 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO dbcounter [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Registered counter for database nova_api Aug 24 04:50:44.517438 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_db.sqlalchemy.engines [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.521711 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_db.sqlalchemy.engines [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.524739 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writer thread running {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.528390 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writer thread running {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.583862 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.context [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0413d8ab-f0c6-4531-9b34-84e3064b5ca2(cell1) {{(pid=106839) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:50:44.585366 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.context [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0413d8ab-f0c6-4531-9b34-84e3064b5ca2(cell1) {{(pid=106840) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:50:44.587677 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.588163 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.589181 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.589654 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.589746 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.590482 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.590932 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.591271 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.591998 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.592442 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.592953 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.594433 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_concurrency.lockutils [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.594937 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO dbcounter [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Registered counter for database nova_cell0 Aug 24 04:50:44.596415 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO dbcounter [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Registered counter for database nova_cell0 Aug 24 04:50:44.601208 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO dbcounter [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Registered counter for database nova_cell1 Aug 24 04:50:44.602686 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO dbcounter [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Registered counter for database nova_cell1 Aug 24 04:50:44.608536 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_db.sqlalchemy.engines [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.610212 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_db.sqlalchemy.engines [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.612396 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_db.sqlalchemy.engines [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.614102 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_db.sqlalchemy.engines [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.616251 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writer thread running {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.619246 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writer thread running {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.620144 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writer thread running {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.622463 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writer thread running {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.762928 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO dbcounter [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Registered counter for database nova_cell0 Aug 24 04:50:44.767546 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO dbcounter [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Registered counter for database nova_cell0 Aug 24 04:50:44.770971 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_db.sqlalchemy.engines [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.775446 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writer thread running {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:44.777208 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG oslo_db.sqlalchemy.engines [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:50:44.781630 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writer thread running {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:50:45.199849 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: WARNING keystonemiddleware.auth_token [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:50:45.207467 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: WARNING keystonemiddleware.auth_token [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:50:45.333559 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: WARNING keystonemiddleware.auth_token [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:50:45.340935 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: WARNING keystonemiddleware.auth_token [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:50:45.551458 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: WARNING keystonemiddleware.auth_token [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:50:45.557983 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: WARNING keystonemiddleware.auth_token [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:50:45.563483 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f98d5219c0 pid: 106839 (default app) Aug 24 04:50:45.566564 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:45.567818 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] 10.222.0.105 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.002763 Aug 24 04:50:45.568245 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 1/1] 10.222.0.105 () {50 vars in 793 bytes} [Wed Aug 24 04:50:45 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:45.688920 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: WARNING keystonemiddleware.auth_token [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:50:45.695488 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: WARNING keystonemiddleware.auth_token [None req-ec0d8e55-7cf4-46d8-afbd-7e98aa8aa0b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:50:45.700756 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f98d5219c0 pid: 106840 (default app) Aug 24 04:52:06.769240 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:06.770149 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001419 Aug 24 04:52:06.770554 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 2/2] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:06.783789 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_api:SELECT=3 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:06.785128 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_cell0:SELECT=3 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:06.786333 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_cell1:SELECT=3 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:06.787399 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.802535 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-18cc2bcc-0380-4220-8123-d9ddc15825a4 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:07.834884 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-18cc2bcc-0380-4220-8123-d9ddc15825a4 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.056669 Aug 24 04:52:07.835585 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 1/3] 10.222.0.105 () {60 vars in 1297 bytes} [Wed Aug 24 04:52:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:10.245247 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.246433 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-3b09390c-bb60-47a1-8a35-00b1d0620759 None None] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002295 Aug 24 04:52:10.246999 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 3/4] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:10.692174 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-9d0b6a03-acbf-413c-aedf-5d19c97f970a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:10.712927 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:10.712927 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: warnings.warn(msg) Aug 24 04:52:10.846450 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-9d0b6a03-acbf-413c-aedf-5d19c97f970a admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.593485 Aug 24 04:52:10.847319 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 2/5] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:10.861180 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_api:SELECT=3 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:10.862278 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_cell0:SELECT=3 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:10.863504 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_cell1:SELECT=3 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:10.865055 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:11.090729 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-2139a2e4-5bb2-43fc-84b4-11bce5689513 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:11.090729 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:11.090729 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:52:11.396235 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-2139a2e4-5bb2-43fc-84b4-11bce5689513 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.540379 Aug 24 04:52:11.397001 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 4/6] 10.222.0.105 () {64 vars in 1341 bytes} [Wed Aug 24 04:52:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:13.761774 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-9d0b6a03-acbf-413c-aedf-5d19c97f970a admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:13.762688 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-9d0b6a03-acbf-413c-aedf-5d19c97f970a admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Aug 24 04:52:13.763101 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 3/7] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:52:14.413433 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-f00fd07f-68a0-4c4d-9580-270ea68f701d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:14.432898 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:14.432898 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:52:14.527174 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-f00fd07f-68a0-4c4d-9580-270ea68f701d admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.757631 Aug 24 04:52:14.528073 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 5/8] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:52:14.540229 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-9cf224d7-b21f-4a90-a39a-0ac4cfa85544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:14.544148 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:14.544148 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: warnings.warn(msg) Aug 24 04:52:14.656665 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-9cf224d7-b21f-4a90-a39a-0ac4cfa85544 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120258 Aug 24 04:52:14.657401 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 4/9] 10.222.0.105 () {64 vars in 1341 bytes} [Wed Aug 24 04:52:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:17.023162 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-f00fd07f-68a0-4c4d-9580-270ea68f701d admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:17.024082 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-f00fd07f-68a0-4c4d-9580-270ea68f701d admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001474 Aug 24 04:52:17.024481 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 6/10] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:17.423702 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6a780b21-bced-4b8d-ab2d-756e7a05828a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:17.496804 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-6a780b21-bced-4b8d-ab2d-756e7a05828a admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.465250 Aug 24 04:52:17.497365 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 5/11] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:17.510107 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-2dfb101b-0257-4ed2-b4cf-d80dc9c7fb5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:17.586239 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-2dfb101b-0257-4ed2-b4cf-d80dc9c7fb5f admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080270 Aug 24 04:52:17.586787 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 7/12] 10.222.0.105 () {64 vars in 1341 bytes} [Wed Aug 24 04:52:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:52:20.039631 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6a780b21-bced-4b8d-ab2d-756e7a05828a admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:20.040817 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-6a780b21-bced-4b8d-ab2d-756e7a05828a admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001587 Aug 24 04:52:20.041295 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 6/13] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:20 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:20.465153 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-73954c08-76c0-41d7-8a61-71370c64d03c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:20.537252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-73954c08-76c0-41d7-8a61-71370c64d03c admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.489712 Aug 24 04:52:20.538144 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 8/14] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:20.550848 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-59c3fec0-0141-4d91-a9c4-563138760150 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:20.625399 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-59c3fec0-0141-4d91-a9c4-563138760150 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078590 Aug 24 04:52:20.635075 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 7/15] 10.222.0.105 () {64 vars in 1341 bytes} [Wed Aug 24 04:52:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:23.012653 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-73954c08-76c0-41d7-8a61-71370c64d03c admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.013660 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-73954c08-76c0-41d7-8a61-71370c64d03c admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 Aug 24 04:52:23.014239 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 9/16] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:23.453159 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:23.540272 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519665 Aug 24 04:52:23.540931 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 8/17] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:52:23.553229 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-becf5734-a7bc-4325-ba39-5353942b7e27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:23.642370 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-becf5734-a7bc-4325-ba39-5353942b7e27 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092706 Aug 24 04:52:23.643339 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 10/18] 10.222.0.105 () {64 vars in 1341 bytes} [Wed Aug 24 04:52:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:26.263423 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.264430 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001533 Aug 24 04:52:26.264805 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 9/19] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:26.682602 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-e597d31d-b55a-4b3c-a22c-1570f5d7734a admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.706883 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-e597d31d-b55a-4b3c-a22c-1570f5d7734a admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.435456 Aug 24 04:52:26.707391 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 11/20] 10.222.0.105 () {60 vars in 1297 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:29.055501 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.057892 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-794d691c-c22b-4bef-b52f-004278d23e7e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003073 Aug 24 04:52:29.058441 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 10/21] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:29.490886 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-1614211a-e917-446e-8bc1-6214dca37b6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "vcpus": 1}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:29.574791 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-1614211a-e917-446e-8bc1-6214dca37b6e admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510042 Aug 24 04:52:29.575715 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 12/22] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:29.592873 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-fece82f6-be1d-41cc-a908-66fec766bfa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:29.666691 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-fece82f6-be1d-41cc-a908-66fec766bfa0 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079388 Aug 24 04:52:29.667229 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 11/23] 10.222.0.105 () {64 vars in 1338 bytes} [Wed Aug 24 04:52:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:32.030560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-1614211a-e917-446e-8bc1-6214dca37b6e admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.032037 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-1614211a-e917-446e-8bc1-6214dca37b6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001732 Aug 24 04:52:32.032460 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 13/24] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:52:32.400569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-5f3dc3c1-685e-4a70-8ead-aa9f780f1501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:32.484288 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-5f3dc3c1-685e-4a70-8ead-aa9f780f1501 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.445406 Aug 24 04:52:32.484952 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 12/25] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:52:32.498992 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-8e7ea9cc-4a55-4d82-bd1f-970ca28b55e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:32.590824 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-8e7ea9cc-4a55-4d82-bd1f-970ca28b55e6 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097128 Aug 24 04:52:32.591579 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 14/26] 10.222.0.105 () {64 vars in 1338 bytes} [Wed Aug 24 04:52:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:35.032255 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-5f3dc3c1-685e-4a70-8ead-aa9f780f1501 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:35.033275 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-5f3dc3c1-685e-4a70-8ead-aa9f780f1501 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001461 Aug 24 04:52:35.033681 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 13/27] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:35 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:35.558361 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-0a2c09a5-c828-4586-90dd-2216b52242d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:35.656999 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-0a2c09a5-c828-4586-90dd-2216b52242d0 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.615654 Aug 24 04:52:35.657810 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 15/28] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:35.675453 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-289cd70d-dd34-4bb2-ad3b-731a22bb57a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:35.758344 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-289cd70d-dd34-4bb2-ad3b-731a22bb57a4 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088969 Aug 24 04:52:35.759443 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 14/29] 10.222.0.105 () {64 vars in 1338 bytes} [Wed Aug 24 04:52:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:38.285023 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-0a2c09a5-c828-4586-90dd-2216b52242d0 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:38.286034 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-0a2c09a5-c828-4586-90dd-2216b52242d0 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001455 Aug 24 04:52:38.286443 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 16/30] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:38 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:38.749236 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6ab52d81-78c6-4428-8215-3a02a2f3bbff admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:38.755773 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:38.856137 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-6ab52d81-78c6-4428-8215-3a02a2f3bbff admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.563221 Aug 24 04:52:38.859121 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 15/31] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:38.870410 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-8ae6fb44-9a58-4bb2-a276-768e5b6e247e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:38.948544 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-8ae6fb44-9a58-4bb2-a276-768e5b6e247e admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082985 Aug 24 04:52:38.949233 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 17/32] 10.222.0.105 () {64 vars in 1338 bytes} [Wed Aug 24 04:52:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:41.343762 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6ab52d81-78c6-4428-8215-3a02a2f3bbff admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:41.345450 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-6ab52d81-78c6-4428-8215-3a02a2f3bbff admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002181 Aug 24 04:52:41.346081 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 16/33] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:52:41 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:41.788549 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "id": "5"}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:41.872721 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.520427 Aug 24 04:52:41.874953 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 18/34] 10.222.0.105 () {64 vars in 1288 bytes} [Wed Aug 24 04:52:41 2022] POST /compute/v2.1/flavors => generated 410 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:41.888139 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-5e43b75a-ee64-499d-9ccc-ed678a0c9640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:41.986082 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-5e43b75a-ee64-499d-9ccc-ed678a0c9640 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102461 Aug 24 04:52:41.986719 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 17/35] 10.222.0.105 () {64 vars in 1338 bytes} [Wed Aug 24 04:52:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:53:01.284106 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:01.285177 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001513 Aug 24 04:53:01.285586 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 19/36] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:53:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:01.681725 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-71580c3b-ac7f-438b-a3cc-50be6ee1a888 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:01.700479 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-71580c3b-ac7f-438b-a3cc-50be6ee1a888 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.408096 Aug 24 04:53:01.700948 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 18/37] 10.222.0.105 () {60 vars in 1297 bytes} [Wed Aug 24 04:53:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:02.758778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:02.760132 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-b381fd42-6c74-4620-8027-78a4b193e130 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001776 Aug 24 04:53:02.760561 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 20/38] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:02 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:03.279008 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-1cd3fe12-5b2e-4142-b8bf-6894b1cb2065 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.284763 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.wsgi [None req-1cd3fe12-5b2e-4142-b8bf-6894b1cb2065 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-1cd3fe12-5b2e-4142-b8bf-6894b1cb2065 admin admin] Request method failure captured: Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept: application/json Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept-Encoding: gzip, deflate Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Connection: keep-alive Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Content-Length: 0 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Host: 10.222.0.105 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-System-Scope: None Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: User-Agent: python-novaclient Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Auth-Token: gAAAAABjBa6u6bTAWl5STQLs1y1xJu42JuUzKhDRvq7ODkIqFDXZCWHCXhiVc2mmkmDSlMTDQ3Bq0qEIyVsCEeyOwAusvntpKM0zVKTxt2yEu74IkwlOS5kixoCcD9gHCKHPIhhIMn4P-qqZaTBY9ffxyxYIBuxz_NVKDuZJvpDlxlx6KPOJjvQ Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Id: None Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Name: None Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Identity-Status: Confirmed Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Is-Admin-Project: True Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Id: default Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Name: Default Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Name: admin Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Role: reader,member,admin Aug 24 04:53:03.287981 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Roles: reader,member,admin Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant: admin Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Name: admin Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User: admin Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Id: default Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Name: Default Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Name: admin Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: method: > Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: exception: Flavor 42 could not be found. Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: action_args: {'id': '42'} Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:03.289563 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:03.290569 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.291847 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-1cd3fe12-5b2e-4142-b8bf-6894b1cb2065 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:03.292877 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-1cd3fe12-5b2e-4142-b8bf-6894b1cb2065 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391972 Aug 24 04:53:03.294512 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 19/39] 10.222.0.105 () {60 vars in 1195 bytes} [Wed Aug 24 04:53:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:03.299564 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-eec6525d-ca39-4db2-86c2-1231bbbd7908 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.303827 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:03.322977 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-eec6525d-ca39-4db2-86c2-1231bbbd7908 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027201 Aug 24 04:53:03.323545 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 21/40] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:53:03.333219 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-d17bbf83-dda5-4ee2-9527-5be543b21833 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.357718 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-d17bbf83-dda5-4ee2-9527-5be543b21833 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028095 Aug 24 04:53:03.358256 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 20/41] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:03.367685 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-6cf2bdd9-5e8a-41b1-9db4-9be6c42aa8a4 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.373984 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.wsgi [None req-6cf2bdd9-5e8a-41b1-9db4-9be6c42aa8a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-6cf2bdd9-5e8a-41b1-9db4-9be6c42aa8a4 admin admin] Request method failure captured: Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept: application/json Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept-Encoding: gzip, deflate Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Connection: keep-alive Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Content-Length: 0 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Host: 10.222.0.105 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-System-Scope: None Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: User-Agent: python-novaclient Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Auth-Token: gAAAAABjBa6u6bTAWl5STQLs1y1xJu42JuUzKhDRvq7ODkIqFDXZCWHCXhiVc2mmkmDSlMTDQ3Bq0qEIyVsCEeyOwAusvntpKM0zVKTxt2yEu74IkwlOS5kixoCcD9gHCKHPIhhIMn4P-qqZaTBY9ffxyxYIBuxz_NVKDuZJvpDlxlx6KPOJjvQ Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Id: None Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Name: None Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Identity-Status: Confirmed Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Is-Admin-Project: True Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Id: default Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Name: Default Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Name: admin Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Role: reader,member,admin Aug 24 04:53:03.377252 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Roles: reader,member,admin Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant: admin Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Name: admin Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User: admin Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Id: default Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Name: Default Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Name: admin Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: method: > Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: exception: Flavor 42 could not be found. Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: action_args: {'id': '42'} Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:03.380560 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:03.381381 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:03.382437 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-6cf2bdd9-5e8a-41b1-9db4-9be6c42aa8a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:03.383608 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-6cf2bdd9-5e8a-41b1-9db4-9be6c42aa8a4 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014589 Aug 24 04:53:03.383608 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 22/42] 10.222.0.105 () {60 vars in 1195 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:04.357181 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-d17bbf83-dda5-4ee2-9527-5be543b21833 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.358310 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-d17bbf83-dda5-4ee2-9527-5be543b21833 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001551 Aug 24 04:53:04.358710 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 21/43] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:04.883440 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-d3e5345a-0b87-4d41-a137-bb6d08bbb977 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.889412 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.wsgi [None req-d3e5345a-0b87-4d41-a137-bb6d08bbb977 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-d3e5345a-0b87-4d41-a137-bb6d08bbb977 admin admin] Request method failure captured: Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept: application/json Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept-Encoding: gzip, deflate Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Connection: keep-alive Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Content-Length: 0 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Host: 10.222.0.105 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-System-Scope: None Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: User-Agent: python-novaclient Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Auth-Token: gAAAAABjBa6w-K7FoPD7dASLnc5jk4ad9tOy-SxXXaWAkz4eH77C6u3cKo-TX8BIJat21gOOU0PkO_SZZS1D2Ad9DdZqUhAP9bPI-6zFYn1EK4wqRCfV_qEHCwTH3ffrJCduQYlyuR6lBQnqM3W8q6sSD9aGSuy0SbdUewweIiI7jjPXmLyss2A Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Id: None Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Name: None Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Identity-Status: Confirmed Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Is-Admin-Project: True Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Id: default Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Name: Default Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Name: admin Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Role: reader,member,admin Aug 24 04:53:04.893783 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Roles: reader,member,admin Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant: admin Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Name: admin Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User: admin Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Id: default Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Name: Default Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Name: admin Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: method: > Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: exception: Flavor 84 could not be found. Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: action_args: {'id': '84'} Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:04.895298 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:04.896110 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.897453 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-d3e5345a-0b87-4d41-a137-bb6d08bbb977 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:04.898731 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-d3e5345a-0b87-4d41-a137-bb6d08bbb977 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395322 Aug 24 04:53:04.898731 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 23/44] 10.222.0.105 () {60 vars in 1195 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:04.902788 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-fbfd1341-2563-4fc5-b58f-c1adf6741271 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.917966 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-fbfd1341-2563-4fc5-b58f-c1adf6741271 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019456 Aug 24 04:53:04.918525 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 22/45] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:04.928523 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-eac6d6d6-74be-4069-a626-eb29a9a2144d admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.945276 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-eac6d6d6-74be-4069-a626-eb29a9a2144d admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020475 Aug 24 04:53:04.945826 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 24/46] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:04.955941 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-bbf54871-f04f-4b1c-a706-16b0a1e2a337 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.961267 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.wsgi [None req-bbf54871-f04f-4b1c-a706-16b0a1e2a337 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-bbf54871-f04f-4b1c-a706-16b0a1e2a337 admin admin] Request method failure captured: Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept: application/json Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept-Encoding: gzip, deflate Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Connection: keep-alive Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Content-Length: 0 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Host: 10.222.0.105 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-System-Scope: None Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: User-Agent: python-novaclient Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Auth-Token: gAAAAABjBa6w-K7FoPD7dASLnc5jk4ad9tOy-SxXXaWAkz4eH77C6u3cKo-TX8BIJat21gOOU0PkO_SZZS1D2Ad9DdZqUhAP9bPI-6zFYn1EK4wqRCfV_qEHCwTH3ffrJCduQYlyuR6lBQnqM3W8q6sSD9aGSuy0SbdUewweIiI7jjPXmLyss2A Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Id: None Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Name: None Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Identity-Status: Confirmed Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Is-Admin-Project: True Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Id: default Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Name: Default Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Name: admin Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Role: reader,member,admin Aug 24 04:53:04.963602 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Roles: reader,member,admin Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant: admin Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Name: admin Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User: admin Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Id: default Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Name: Default Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Name: admin Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: method: > Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: exception: Flavor 84 could not be found. Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: action_args: {'id': '84'} Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:04.965142 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:04.966195 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:04.972451 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-bbf54871-f04f-4b1c-a706-16b0a1e2a337 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:04.973905 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-bbf54871-f04f-4b1c-a706-16b0a1e2a337 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012627 Aug 24 04:53:04.973905 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 23/47] 10.222.0.105 () {60 vars in 1195 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:05.933255 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-eac6d6d6-74be-4069-a626-eb29a9a2144d admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:05.934266 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-eac6d6d6-74be-4069-a626-eb29a9a2144d admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 Aug 24 04:53:05.934663 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 25/48] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:05 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:06.457746 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6b7cbaf5-a86c-4762-aef9-60b331f70361 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.463630 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.wsgi [None req-6b7cbaf5-a86c-4762-aef9-60b331f70361 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6b7cbaf5-a86c-4762-aef9-60b331f70361 admin admin] Request method failure captured: Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept: application/json Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Accept-Encoding: gzip, deflate Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Connection: keep-alive Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Content-Length: 0 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Host: 10.222.0.105 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Openstack-System-Scope: None Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: User-Agent: python-novaclient Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Auth-Token: gAAAAABjBa6xtm4ZZsFBeEzH25RfXEuURAFspRlZAh4bGNyoM3SVOysD5Q8ryVJsjDlz5gr23jGYo_rmPz3sJBzb0N7gtH6xWHXQLqB6N9bLUby0Tsym68qRYxmpDhoV6XT1Z4TrMEvQLCHaZMXAhHjr6jCjHX4He5NkXb3whEHE4YIC4EJWR0Y Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Id: None Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Domain-Name: None Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Identity-Status: Confirmed Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Is-Admin-Project: True Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Id: default Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Domain-Name: Default Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Project-Name: admin Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Role: reader,member,admin Aug 24 04:53:06.465123 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Roles: reader,member,admin Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant: admin Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-Tenant-Name: admin Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User: admin Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Id: default Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Domain-Name: Default Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: X-User-Name: admin Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: method: > Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: exception: Flavor 451 could not be found. Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: action_args: {'id': '451'} Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:06.466671 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:06.467754 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.469132 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-6b7cbaf5-a86c-4762-aef9-60b331f70361 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:06.470391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-6b7cbaf5-a86c-4762-aef9-60b331f70361 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390260 Aug 24 04:53:06.470391 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 24/49] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 04:53:06.476065 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-a0bac47f-69b0-494d-84d4-b6f5b0ef2864 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.491778 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-a0bac47f-69b0-494d-84d4-b6f5b0ef2864 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019260 Aug 24 04:53:06.492340 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 26/50] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:06.502268 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.516900 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018145 Aug 24 04:53:06.517439 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 25/51] 10.222.0.105 () {60 vars in 1215 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:06.526698 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3f12753d-e086-4969-85b6-494df8349cb5 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:06.531939 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.wsgi [None req-3f12753d-e086-4969-85b6-494df8349cb5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3f12753d-e086-4969-85b6-494df8349cb5 admin admin] Request method failure captured: Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept: application/json Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Accept-Encoding: gzip, deflate Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Connection: keep-alive Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Content-Length: 0 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Host: 10.222.0.105 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-Api-Version: compute 2.90 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Openstack-System-Scope: None Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: User-Agent: python-novaclient Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Auth-Token: gAAAAABjBa6xtm4ZZsFBeEzH25RfXEuURAFspRlZAh4bGNyoM3SVOysD5Q8ryVJsjDlz5gr23jGYo_rmPz3sJBzb0N7gtH6xWHXQLqB6N9bLUby0Tsym68qRYxmpDhoV6XT1Z4TrMEvQLCHaZMXAhHjr6jCjHX4He5NkXb3whEHE4YIC4EJWR0Y Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Id: None Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Domain-Name: None Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Identity-Status: Confirmed Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Is-Admin-Project: True Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Id: default Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Domain-Name: Default Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Project-Name: admin Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Role: reader,member,admin Aug 24 04:53:06.533417 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Roles: reader,member,admin Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e02e910be5274b36b8f63c2185a111d4", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e02e910be5274b36b8f63c2185a111d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e02e910be5274b36b8f63c2185a111d4"}]}] Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant: admin Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Id: e02e910be5274b36b8f63c2185a111d4 Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-Tenant-Name: admin Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User: admin Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Id: default Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Domain-Name: Default Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Id: f6a4ad480e8041b39ccfa602ac02988c Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: X-User-Name: admin Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: method: > Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: exception: Flavor 451 could not be found. Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: action_args: {'id': '451'} Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:06.534980 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:06.535981 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: ERROR nova.api.openstack.wsgi Aug 24 04:53:06.537131 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-3f12753d-e086-4969-85b6-494df8349cb5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:06.538145 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-3f12753d-e086-4969-85b6-494df8349cb5 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011880 Aug 24 04:53:06.538145 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 27/52] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:53:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:07.515957 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:07.516970 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Aug 24 04:53:07.517367 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 26/53] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:08.041311 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-b9456d25-776a-4a9e-9861-18e4e076a8f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:08.116705 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-b9456d25-776a-4a9e-9861-18e4e076a8f7 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.459913 Aug 24 04:53:08.117248 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 28/54] 10.222.0.105 () {64 vars in 1240 bytes} [Wed Aug 24 04:53:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:53:09.094197 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:09.095236 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Aug 24 04:53:09.095625 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 27/55] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:09 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:09.614095 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-2e4809e5-2ede-410f-a679-68c3876918a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:09.678566 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-2e4809e5-2ede-410f-a679-68c3876918a7 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444120 Aug 24 04:53:09.679117 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 29/56] 10.222.0.105 () {64 vars in 1240 bytes} [Wed Aug 24 04:53:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:53:10.675898 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:10.676907 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001503 Aug 24 04:53:10.677298 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 28/57] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:11.201306 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-1258ad50-65cb-4484-8366-dd348e93e3fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:11.277092 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-1258ad50-65cb-4484-8366-dd348e93e3fe admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.460445 Aug 24 04:53:11.277638 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 30/58] 10.222.0.105 () {64 vars in 1240 bytes} [Wed Aug 24 04:53:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:53:12.248194 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:12.249226 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001428 Aug 24 04:53:12.249601 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 29/59] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:12.889842 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-539ca065-f6dc-406f-a00b-b413007ceb3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:12.976038 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-539ca065-f6dc-406f-a00b-b413007ceb3e admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.588461 Aug 24 04:53:12.976580 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 31/60] 10.222.0.105 () {64 vars in 1240 bytes} [Wed Aug 24 04:53:12 2022] POST /compute/v2.1/flavors => generated 411 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:53:13.953272 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:13.954309 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Aug 24 04:53:13.954709 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 30/61] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:53:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:14.477166 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-693707a0-52eb-4e46-b8e8-47bb87e5c568 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:14.498636 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-693707a0-52eb-4e46-b8e8-47bb87e5c568 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.404876 Aug 24 04:53:14.499196 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 32/62] 10.222.0.105 () {60 vars in 1207 bytes} [Wed Aug 24 04:53:14 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:08.056656 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.057664 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-0a39f93f-ed80-420a-a291-5fc64f3f3129 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001531 Aug 24 04:54:08.058093 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 31/63] 10.222.0.105 () {54 vars in 936 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:08.068426 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:08.450891 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-0d9dad9e-6c0a-47bd-8c6a-9cc53efd158e admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.472017 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-0d9dad9e-6c0a-47bd-8c6a-9cc53efd158e admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.407982 Aug 24 04:54:08.472555 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 33/64] 10.222.0.105 () {60 vars in 1297 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:54:08.496603 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-af794942-82d2-4c76-99e8-d24a522fc759 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.500247 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG dbcounter [-] [106840] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:08.505184 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-af794942-82d2-4c76-99e8-d24a522fc759 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012975 Aug 24 04:54:08.505705 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 32/65] 10.222.0.105 () {60 vars in 1288 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:08.518322 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-34886441-b5e6-4cb0-aa21-9fb6ee0cd9f5 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.526351 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-34886441-b5e6-4cb0-aa21-9fb6ee0cd9f5 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011834 Aug 24 04:54:08.528470 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 34/66] 10.222.0.105 () {60 vars in 1291 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:08.538385 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.546884 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012147 Aug 24 04:54:08.547438 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 33/67] 10.222.0.105 () {60 vars in 1291 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:08.559865 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-9dcceb5a-4f48-409c-9e70-a7f148ce67e2 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.567671 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-9dcceb5a-4f48-409c-9e70-a7f148ce67e2 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012058 Aug 24 04:54:08.568191 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 35/68] 10.222.0.105 () {60 vars in 1288 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:23.334498 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:23.339859 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001497 Aug 24 04:57:23.339859 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 34/69] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:57:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:23.478478 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_api:SELECT=6 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:23.634383 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:23.636835 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:57:23.636835 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:57:23.637983 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:23.638481 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:23.638910 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:23.639649 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:23.640096 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:23.640514 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:23.674575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-61b2d9ab-50e9-4b93-9e6d-aeb002511a32 admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197535 Aug 24 04:57:23.675162 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 36/70] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:57:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:57:24.509783 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:24.510792 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001422 Aug 24 04:57:24.511314 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 35/71] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:57:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:24.702315 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:24.704770 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:57:24.704770 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:57:24.705901 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:24.706376 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:24.706803 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:24.707591 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:24.708190 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:24.708613 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:24.728093 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-89d8012e-54bb-4e3f-a174-a0a3612bcebf admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078081 Aug 24 04:57:24.728583 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 37/72] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:57:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:57:35.983169 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:35.984184 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001453 Aug 24 04:57:35.984578 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 36/73] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:57:35 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:36.130223 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_cell0:SELECT=4 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:36.130950 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_cell1:SELECT=4 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:36.131605 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG dbcounter [-] [106839] Writing DB stats nova_api:SELECT=8 {{(pid=106839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:36.180344 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:36.183042 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:57:36.183042 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:57:36.184188 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.184644 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.185067 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.185774 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.186215 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.186627 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.212379 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-10f769bd-2aae-4110-8c9b-fd547a955ffd admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086526 Aug 24 04:57:36.212883 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 38/74] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:57:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:57:37.058490 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: DEBUG nova.api.openstack.wsgi [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] Calling method '>' {{(pid=106840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:37.059532 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: INFO nova.api.openstack.requestlog [None req-44ee78b7-3497-407d-a62d-a1b3fb633557 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Aug 24 04:57:37.059929 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: [pid: 106840|app: 0|req: 37/75] 10.222.0.105 () {56 vars in 1079 bytes} [Wed Aug 24 04:57:37 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:37.263136 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG nova.api.openstack.wsgi [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Calling method '>' {{(pid=106839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:37.265575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:57:37.265575 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: warnings.warn(msg) Aug 24 04:57:37.266674 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.267196 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.267688 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.268401 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.268851 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.269270 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: DEBUG oslo_concurrency.lockutils [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.293478 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: INFO nova.api.openstack.requestlog [None req-b9979504-4d74-4347-8a45-8cecf35556cc admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082886 Aug 24 04:57:37.305476 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: [pid: 106839|app: 0|req: 39/76] 10.222.0.105 () {60 vars in 1198 bytes} [Wed Aug 24 04:57:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:58:34.398108 dv-cinder-854265-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 04:58:34.398973 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: Wed Aug 24 04:58:34 2022 - graceful shutdown triggered... Aug 24 04:58:34.400040 dv-cinder-854265-1-iscsi devstack@n-api.service[106839]: Gracefully killing worker 1 (pid: 106839)... Aug 24 04:58:34.400608 dv-cinder-854265-1-iscsi devstack@n-api.service[106840]: Gracefully killing worker 2 (pid: 106840)... Aug 24 04:58:35.400133 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: worker 1 buried after 1 seconds Aug 24 04:58:35.400736 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: worker 2 buried after 1 seconds Aug 24 04:58:35.400736 dv-cinder-854265-1-iscsi devstack@n-api.service[106838]: goodbye to uWSGI. Aug 24 04:58:35.401784 dv-cinder-854265-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 04:58:35.402353 dv-cinder-854265-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 04:58:35.405161 dv-cinder-854265-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:58:35.415071 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:58:35 2022] *** Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: nodename: dv-cinder-854265-1-iscsi Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: machine: x86_64 Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: clock source: unix Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: pcre jit disabled Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: detected number of CPU cores: 4 Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: current working directory: / Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:58:35.417598 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: your processes number limit is 47680 Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: your memory page size is 4096 bytes Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: detected max file descriptor number: 2048 Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: lock engine: pthread robust mutexes Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: thunder lock: enabled Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:58:35.418382 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:58:35.461034 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: Python main interpreter initialized at 0x55a6957bc9c0 Aug 24 04:58:35.461034 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: python threads support enabled Aug 24 04:58:35.461034 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: your server socket listen backlog is limited to 100 connections Aug 24 04:58:35.461034 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:58:35.461460 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:58:35.461460 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: *** Operational MODE: preforking *** Aug 24 04:58:35.461649 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:58:35.461649 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: spawned uWSGI master process (pid: 122256) Aug 24 04:58:35.461856 dv-cinder-854265-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:58:35.463102 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: spawned uWSGI worker 1 (pid: 122276, cores: 1) Aug 24 04:58:35.463102 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: spawned uWSGI worker 2 (pid: 122277, cores: 1) Aug 24 04:58:35.463405 dv-cinder-854265-1-iscsi devstack@n-api.service[122256]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:58:36.131106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:58:36.132951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:58:37.312671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:58:37.312671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: from cryptography.utils import int_from_bytes Aug 24 04:58:37.313297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:58:37.313297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: from cryptography.utils import int_from_bytes Aug 24 04:58:37.313729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:58:37.313729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: from cryptography.utils import int_from_bytes Aug 24 04:58:37.313868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:58:37.313868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: from cryptography.utils import int_from_bytes Aug 24 04:58:39.731420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:58:39.731878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:58:39.732235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:58:39.732611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:58:39.732876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:58:39.733286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.733605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.733937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.734265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.734755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.735104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.735441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.735771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.736109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.736379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.736784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.737051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-1-iscsi {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.737354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.737669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.737986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.738313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.738631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.738969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.739311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.739822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.745813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-1-iscsi {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.746954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.747554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.747554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.747700 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.748469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.748469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.748748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.749069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.749400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.749713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.750025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.750289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.750603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.750934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.751290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.751623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.751879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.752135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.752462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.752790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.753106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.753420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.753733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.754044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.754356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.754668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.754979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.755314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.755636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.755957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.756282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.756594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.756918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.757074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:58:39.757565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:58:39.757719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.757719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.758007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:58:39.758151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.758294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:58:39.758446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.758600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:58:39.758753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.758906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.759954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.760265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.760440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.760616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.760769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.760940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.761889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.762924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854265-1-iscsi {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.763864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.764017 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.764858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765023 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.765914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.766966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.767930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.768986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854265-1-iscsi {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.769947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770541 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.770987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771787 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.771930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772081 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.772968 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.773118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.773268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.773418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.773579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.773756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.774033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.774206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.775573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.775744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.775898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.776863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.777921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778072 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.778962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.779143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.779291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.779443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.779443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.779786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.779938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.780138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.780285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.780438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.780581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.780743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.780895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.781038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.781181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.781340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.781494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.781653 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.781803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.781947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.782104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.782254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.782397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.782556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.782699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.782848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.783006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.783221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.783364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.783517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.783667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.783819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.783972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.784123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.784265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.784885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.785060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.785215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.785375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.785808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.785958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.786113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.786257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.786414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.786565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.786709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.786852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.787002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.787185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.787356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.787508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.787652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.787806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.787806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.788079 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.788231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.788381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.788524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.788674 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.788823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.788973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.789129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.789292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.789443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.789593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.789786 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.789950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.790094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.790240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.790434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.791234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.791381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.791619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.791866 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.792023 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.792174 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.795275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.795454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.795653 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.796178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.796338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.796494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.796672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.796839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.797001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.797147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.797306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.797465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.797611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.797859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.798029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.798181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.798332 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.798482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.798637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.798789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.798933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.799091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.799240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.799382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.799546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.799704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.799896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.800044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.800201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.800352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.800503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.800653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.800797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.800993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.801156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.801315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.801468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.801640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.801786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.801929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.802080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.802236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.802388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.802539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.802683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.802826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.802977 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.803156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.803156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.803436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.803598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.803741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.803884 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.804037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.804181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.804324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.804479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.804623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.804783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.804957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.805550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.805705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.805867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.806505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.806715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.806880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.807135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.807301 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.807478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.807631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.807785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.807940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.808093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.808244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.808389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.808555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.808785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.808932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.809077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.809220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.809363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.809515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.809666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:58:39.809817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.810627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811788 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.811931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812073 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.812981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.813273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.813273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.813273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.813697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.813920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.814957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.815600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.815755 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.815899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.816042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.816192 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.816554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.816808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.816808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.817861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818013 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.818920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.819097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.819266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.819426 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.819680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.819852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.820973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.821118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.821273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.821429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.822113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.822274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.822468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.822964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.823895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.824937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.825081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.825253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.825802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.825958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.826112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.826263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.826436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.826653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827117 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.827879 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828023 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.828904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829652 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.829803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830579 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.830889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.831993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.832896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.833836 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.834922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.836339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.838243 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.839749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.839915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.840071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.840272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.840564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.840736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.840889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.841948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842700 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.842997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.843202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.843430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.843584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.843740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.843740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.844911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.845066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.845219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.845370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.845513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.846500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.848965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.850049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.851258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.852365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.854013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.855099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.855268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.855414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.855583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.855735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.856369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.856537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.856537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.856821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.856973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.857998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.858152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.858304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.858450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.858615 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.858759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.859897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.860956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.861903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.862685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.864628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.864784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.864935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.865100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.865259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.865574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.865574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.865910 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.873414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.873698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.873873 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.874036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.874333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.874498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.874663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.874835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.875003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.875003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.875391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.875588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.876587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.876764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.876927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.877953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.878106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.878106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.878669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.878874 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.879059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.879230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.879402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.879567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.879978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.880283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.880447 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.880643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.880643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.881922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.882860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883706 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.883876 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.884905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.885309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.885476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.885643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.885878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.886156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.886449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.886774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.886943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.887958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888145 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.888956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.889974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.890891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.891973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.892933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893865 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.893956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.894972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.895971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.896985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897291 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897550 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.897934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898027 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898027 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898826 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.898904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899116 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.899989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900079 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900172 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.900895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.901811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.902950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.903060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.907942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.908956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909512 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.909959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.910881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.911931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912027 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.912920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.913917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914005 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.914981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.915199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.915295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.915915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.916924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917727 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917727 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.917975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.918912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.919966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920270 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.920994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.921959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.922821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.923994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.924903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.925872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.926084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.926193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.926400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.926508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.926854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.927944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928078 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.928891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.929027 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.929190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.929338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.930874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.931008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.931767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.931870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.931960 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.932938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.933983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934509 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.934917 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.935166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.941982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.942944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943737 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.943996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.944899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945116 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.945943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946492 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.946997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.947962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948411 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.948956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.949896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.950998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.951957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952224 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.952964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953622 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953772 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.953922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.954973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.955963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956793 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.956902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957413 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.957943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.958952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959426 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.959895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.960854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.961950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.962095 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.962285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.962518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.962687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.962835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963542 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.963996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964826 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.964963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965108 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.965929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.966971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.967956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968078 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968591 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968891 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.968992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.969903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.970849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.971880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.972842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.973874 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.974915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.975091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.981967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982207 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982848 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.982943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983176 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.983962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.984992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.985943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986148 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.986912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.987920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.988950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989428 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.989893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.990981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991844 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.991931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992487 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.992863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.993074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.993182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.993383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.993526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.994384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.994516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.994846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.994955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995192 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995856 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.995955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.996150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.996296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.996469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.996602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.996789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997426 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.997877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.998846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:39.999980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.000927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.001979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.002172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.002362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.002546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.002649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.002755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:58:40.002856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.003112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.003422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.003729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.004034 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.004347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.004650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.004952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.005308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.005617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.005932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.006238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.006547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.006853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.007182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.007498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.007808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.008136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.008459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.008765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.009148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.009682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.010042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.010377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.010699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.011045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.011389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.016650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.017981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.018442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.018632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.018915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.019243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.019587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.019908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.020222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.020537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.020856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.021169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.021480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.021790 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.022136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.022410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.022739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.023073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.023381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.023801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.024115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.024435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.024847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.025390 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.025886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.026220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.026534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.026859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.027199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.027541 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.027921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.028263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.028590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.028901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.029209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.029517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.029828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.030148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.030478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.030767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.031091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.031402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.031709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.032016 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.032321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.032628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.032939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.033241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.033629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.033894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.034198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.034501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.034801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.035136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.035446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.035772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.036052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.036357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.036661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.036990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.037322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.037640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.037961 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.038272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.038593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.038904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.039249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.039567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.039881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.040189 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.041097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.041660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.041984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.042304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.042621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.042937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.043274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.043603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.043932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.044240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.044567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.044885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.045205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.045671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.045821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.046132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.046442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.046745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.047074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.047385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.047694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.048015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.048322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.048629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.048941 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.049270 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.049572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.049896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.050204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.050526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.050849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.051220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.051533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.051877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.052202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.052515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.052824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.053130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:58:40.053370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:58:40.065424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO dbcounter [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Registered counter for database nova_api Aug 24 04:58:40.085782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.092698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writer thread running {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.116358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO dbcounter [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Registered counter for database nova_api Aug 24 04:58:40.137143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_db.sqlalchemy.engines [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.143664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writer thread running {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.149287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.context [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0413d8ab-f0c6-4531-9b34-84e3064b5ca2(cell1) {{(pid=122277) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:58:40.154091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.154578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.156227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.156973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.157431 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.159463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.161462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO dbcounter [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Registered counter for database nova_cell0 Aug 24 04:58:40.166158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO dbcounter [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Registered counter for database nova_cell1 Aug 24 04:58:40.176915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.179302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.186283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writer thread running {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.188822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writer thread running {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.201612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.context [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0413d8ab-f0c6-4531-9b34-84e3064b5ca2(cell1) {{(pid=122276) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:58:40.205697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.206175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.207774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.208502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.208952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.210915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.213758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO dbcounter [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Registered counter for database nova_cell0 Aug 24 04:58:40.217723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO dbcounter [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Registered counter for database nova_cell1 Aug 24 04:58:40.225062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_db.sqlalchemy.engines [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.227344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_db.sqlalchemy.engines [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.232855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writer thread running {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.335883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO dbcounter [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Registered counter for database nova_cell0 Aug 24 04:58:40.343119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.347754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writer thread running {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.374069 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writer thread running {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.384135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO dbcounter [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Registered counter for database nova_cell0 Aug 24 04:58:40.392284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_db.sqlalchemy.engines [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:58:40.396695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writer thread running {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:58:40.670001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: WARNING keystonemiddleware.auth_token [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:58:40.677360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: WARNING keystonemiddleware.auth_token [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:58:40.722937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: WARNING keystonemiddleware.auth_token [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:58:40.731093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: WARNING keystonemiddleware.auth_token [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:58:41.025505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: WARNING keystonemiddleware.auth_token [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:58:41.030797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: WARNING keystonemiddleware.auth_token [None req-70e8ab5b-0e50-4fe5-a894-b3b46a09dce2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:58:41.036679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6957bc9c0 pid: 122277 (default app) Aug 24 04:58:41.080168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: WARNING keystonemiddleware.auth_token [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:58:41.086179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: WARNING keystonemiddleware.auth_token [None req-28b8d644-5926-437f-a484-244fe75d4c2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:58:41.092313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6957bc9c0 pid: 122276 (default app) Aug 24 04:59:16.963030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:16.963940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:16.964723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:16.965496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:18.263987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d7bc3cd0-67bc-4b2b-916c-8bf6fae94ae8 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Action: 'create', calling method: .version_select at 0x7fde602c15e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1627064817"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:20.731940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d7bc3cd0-67bc-4b2b-916c-8bf6fae94ae8 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.780502 Aug 24 04:59:20.750368 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 1/1] 10.222.0.105 () {60 vars in 1160 bytes} [Wed Aug 24 04:59:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3800 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 24 04:59:20.753277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:20.753936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:20.755911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:20.761080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:21.083589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-21e70ea1-a3f0-47dc-9dfe-c3af01ea8d25 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60311280>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:21.533454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-21e70ea1-a3f0-47dc-9dfe-c3af01ea8d25 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.786411 Aug 24 04:59:21.534023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 1/2] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:20 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:22.549119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4d36984d-3d5d-4fff-8159-6c8e7565c4db tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601954c0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:22.613692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4d36984d-3d5d-4fff-8159-6c8e7565c4db tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 346 microversion: 2.1 time: 0.068696 Aug 24 04:59:22.614495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 2/3] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:22 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:22.631214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a4bbf3ea-fdc1-4451-9e59-880f62b9dba7 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Action: 'create', calling method: .version_select at 0x7fde601d6700>, body: {"snapshot": {"volume_id": "d79183c6-cd81-4cd4-8075-082f9e2fa7ad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1502005962"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:23.361686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a4bbf3ea-fdc1-4451-9e59-880f62b9dba7 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.735882 Aug 24 04:59:23.361686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 2/4] 10.222.0.105 () {60 vars in 1167 bytes} [Wed Aug 24 04:59:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:23.378500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f530c4b8-bdb7-4f31-9ba8-ee4123cb89cc tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60195b80>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:23.521625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f530c4b8-bdb7-4f31-9ba8-ee4123cb89cc tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.141947 Aug 24 04:59:23.521625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 3/5] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:23 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:23.527362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-db55ad33-ce8a-49e3-8bbd-85af699bc916 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601d63a0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:23.670242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-db55ad33-ce8a-49e3-8bbd-85af699bc916 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.147027 Aug 24 04:59:23.671648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 3/6] 10.222.0.105 () {58 vars in 1145 bytes} [Wed Aug 24 04:59:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:23.684937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-277d2c95-2844-4062-baba-49a7d7674a8c tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601ad310>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:23.759040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-277d2c95-2844-4062-baba-49a7d7674a8c tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.080777 Aug 24 04:59:23.760410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 4/7] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:23 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:24.773368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-68a7415a-e131-48f4-9a12-343aa1f13400 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601ab4c0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:24.859726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-68a7415a-e131-48f4-9a12-343aa1f13400 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.091588 Aug 24 04:59:24.860714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 4/8] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:24 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:25.874239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fb113728-d4d4-46d5-8491-c551f8b44515 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60195b80>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:26.047779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fb113728-d4d4-46d5-8491-c551f8b44515 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.178254 Aug 24 04:59:26.048773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 5/9] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:25 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:27.060682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3479a012-0d60-4909-9888-9f0ee576db1c tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60199700>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:27.113424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3479a012-0d60-4909-9888-9f0ee576db1c tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.056810 Aug 24 04:59:27.114300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 5/10] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:27 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:28.126399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-beafeb2d-6162-4414-8e62-36345ef5c670 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60195430>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:28.168859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-beafeb2d-6162-4414-8e62-36345ef5c670 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.040572 Aug 24 04:59:28.168859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 6/11] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:28 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:29.176202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6d450078-f5cd-47ce-8571-3ff81a42acb4 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60b6e9d0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:29.278205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6d450078-f5cd-47ce-8571-3ff81a42acb4 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.106106 Aug 24 04:59:29.278811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 6/12] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:29 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:30.293645 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b401ddb9-e44f-4b4a-9ccf-0e6f7deb38de tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601ad4c0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:30.354507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b401ddb9-e44f-4b4a-9ccf-0e6f7deb38de tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 288 microversion: 2.1 time: 0.065217 Aug 24 04:59:30.369414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 7/13] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:30 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:30.389929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-67f42be1-6859-4278-b473-df5d9ada0614 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601d65e0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:30.506004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2d181048-aff4-4047-a191-5f44432deb29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: .version_select at 0x7fde601ad940>, body: {"keypair": {"name": "tempest-keypair-730240743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbdgMgnGhBpyZ//v4akNofdlnq+Dcs9AhdjgYtq/1RQRDb59/T/TXKlXnbscFCQlBU4dpfuArEA2l1JAFbrmMisWZWI+54KLLr7yTgf0ImdMAejjRjsWJXG/u0PEUAD9A=="}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:30.592282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-2d181048-aff4-4047-a191-5f44432deb29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:30.619208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-2d181048-aff4-4047-a191-5f44432deb29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:30.701907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-67f42be1-6859-4278-b473-df5d9ada0614 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "DELETE /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 202 len: 0 microversion: 2.1 time: 0.324782 Aug 24 04:59:30.701907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 7/14] 10.222.0.105 () {58 vars in 1259 bytes} [Wed Aug 24 04:59:30 2022] DELETE /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:59:30.714371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-71211a13-aed0-4e3f-bd72-d36e0254cd0b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601ab280>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:30.792341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-71211a13-aed0-4e3f-bd72-d36e0254cd0b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 200 len: 287 microversion: 2.1 time: 0.086741 Aug 24 04:59:30.793481 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 8/15] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:30 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:30.808414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2d181048-aff4-4047-a191-5f44432deb29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.433699 Aug 24 04:59:30.809793 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 8/16] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 04:59:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:31.813924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79ac6db7-2dd2-4562-b633-359089cdc318 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60199d30>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:31.928174 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-79ac6db7-2dd2-4562-b633-359089cdc318 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] HTTP exception thrown: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79ac6db7-2dd2-4562-b633-359089cdc318 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Request method failure captured: Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 HTTP/1.1 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAkEeMkVyEM9g-YSsPeUFwMyzuiKYgQ_ds1YTE7oatq5qwmPPuIX0Y6Xi8qX79fZEhZ4t0PjKuZNCCD75yOmHXut50ore_Vq3Fzcri6WXazWUrnZQ0jiZVXGKZpUJxqxbf5x1B9NTaibX9-X1yy_1mx3JaloHGIQrNPVH282q-ojg0 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 04:59:31.933822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_904b8da68db84c3ea1f8785c08ecdc58", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}] Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 00e30c4bef674af481586297243901db Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'b21da501-0572-4859-96b2-8a44afd78390'} Aug 24 04:59:31.934953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. (HTTP 404) (Request-ID: req-746e0f97-ceb6-4245-bd4f-a782d605375c) Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.935612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:31.936454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 04:59:31.937388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. Aug 24 04:59:31.938316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 04:59:31.941813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79ac6db7-2dd2-4562-b633-359089cdc318 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Returning 404 to user: Snapshot b21da501-0572-4859-96b2-8a44afd78390 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:31.945457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-79ac6db7-2dd2-4562-b633-359089cdc318 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390" status: 404 len: 111 microversion: 2.1 time: 0.144047 Aug 24 04:59:31.946585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 9/17] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 04:59:31 2022] GET /compute/v2.1/os-snapshots/b21da501-0572-4859-96b2-8a44afd78390 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:31.957103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-47be6ffb-a844-4ec8-a76c-9d9f2971088f tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde601099d0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:32.561337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-47be6ffb-a844-4ec8-a76c-9d9f2971088f tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 202 len: 0 microversion: 2.1 time: 0.610445 Aug 24 04:59:32.562864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 9/18] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 04:59:31 2022] DELETE /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:59:32.576967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3b3589f5-02b1-4ea5-a074-0de72ba171bc tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60b6e4c0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:32.755499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3b3589f5-02b1-4ea5-a074-0de72ba171bc tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.188512 Aug 24 04:59:32.757309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 10/19] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:32 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:33.529371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ae4a28b5-70d1-4e6d-aa7f-f11062c80b72 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: .version_select at 0x7fde6013d040>, body: {"keypair": {"name": "tempest-keypair-353147498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VvqEeJXpeKgrIPfEs0ypf+fsPt7pJX3rAx4IIaohMszkeVGgfZS6rXA7/u4xxlEzSiOD96YNoPrfBAlo+NhS01V6+ggtSRSz81/vQUTtkpmZ7HT1ZVOS028yx5DmDpQ=="}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:33.579630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-ae4a28b5-70d1-4e6d-aa7f-f11062c80b72 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for project bd6824ae6edd43fcbddb58581134098c. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:33.586831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-ae4a28b5-70d1-4e6d-aa7f-f11062c80b72 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for user b11da4dac5804252b7310be096ae5d53 and project bd6824ae6edd43fcbddb58581134098c. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:33.739283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ae4a28b5-70d1-4e6d-aa7f-f11062c80b72 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323093 Aug 24 04:59:33.740887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 10/20] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 04:59:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:33.770080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4eec504a-8ac1-49ee-9528-8ef2d9d9e37e tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60199e50>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:33.885962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4eec504a-8ac1-49ee-9528-8ef2d9d9e37e tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.119868 Aug 24 04:59:33.891328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 11/21] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:33 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:34.903147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c14b3263-38c9-4b5a-b767-f467d0852651 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde6013df70>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:35.078029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c14b3263-38c9-4b5a-b767-f467d0852651 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.180178 Aug 24 04:59:35.078695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 11/22] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:34 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:35.833743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-df1c16fd-4d56-42c6-a4ec-f577a2a86861 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: .version_select at 0x7fde601ab1f0>, body: {"keypair": {"name": "tempest-keypair-2055917188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvF+FgCG+Okt/d+OGkVNuq5ZCtCwsLN7bwUEg5cNp4aN2BakcE8PJgr/gGRt/WW4e9acw9OEfBJqYmGcTdEG6jt6gZexBu9MJWXu5do4xWgdWLBsLjONpnjXDM823So+g=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:35.945110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-df1c16fd-4d56-42c6-a4ec-f577a2a86861 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for project d373da7992054abfae0564708529a973. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:35.954089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-df1c16fd-4d56-42c6-a4ec-f577a2a86861 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for user 842e7dea2bb24389b900d29351a0bd33 and project d373da7992054abfae0564708529a973. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:36.100564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-58400657-4a0b-44ac-bc87-553b38864aa6 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde60137670>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:36.220641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-58400657-4a0b-44ac-bc87-553b38864aa6 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.125711 Aug 24 04:59:36.227562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 12/23] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:36 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:36.273945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-df1c16fd-4d56-42c6-a4ec-f577a2a86861 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.621975 Aug 24 04:59:36.277200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 12/24] 10.222.0.105 () {62 vars in 1205 bytes} [Wed Aug 24 04:59:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 629 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 04:59:36.352181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1503651281", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "networks": [{"uuid": "3dfd9cd1-130c-4706-921c-e546adc13cdc"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:36.570164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] validate_networks() for [('3dfd9cd1-130c-4706-921c-e546adc13cdc', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:37.251834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-07812023-38d3-4da2-9393-6040146f313b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde600dab80>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:37.353111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-07812023-38d3-4da2-9393-6040146f313b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.114395 Aug 24 04:59:37.354166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 13/25] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:37 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:38.075551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310513513", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2d7953-7d09-41eb-b20e-6de03af460a3"}], "security_groups": [{"name": "tempest-securitygroup--426299801"}], "key_name": "tempest-keypair-730240743", "user_data": "}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:38.134253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:38.134730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:38.135498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:38.136016 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:38.136536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:38.153284 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:38.155166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:38.167293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:38.177926 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:38.181382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:38.182157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:38.280874 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Getting quotas for project ae5545057ecc4c02817cd846dc73b55b. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:38.297991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Getting quotas for user 312b0174466b4b00be19d78bdc01fdb4 and project ae5545057ecc4c02817cd846dc73b55b. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:38.336069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:38.339044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:38.435430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] validate_networks() for [('be2d7953-7d09-41eb-b20e-6de03af460a3', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:38.530719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e853d720-e01e-46a2-a9ee-ae96e4f80a63 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.299705 Aug 24 04:59:38.532353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 13/26] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 04:59:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 04:59:38.654743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-119769004", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:38.774097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] validate_networks() for [('45b5889b-1fed-4157-a576-0b6107ddbe4e', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:39.543816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:39.545434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:39.545434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:39.546218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:39.546832 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:39.561739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:39.562526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:39.563223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:39.564294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:39.564969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:39.565820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:39.604004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:39.614567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:39.630122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:39.639551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:39.771745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:39.772297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:39.772830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:39.773250 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:39.773676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:39.783717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:39.785248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:39.785942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:39.787497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:39.788156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:39.789431 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:39.810357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:39.815057 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for user 51926dd0d6934aed907806a5cb14dc2f and project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:39.835643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:39.838103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:39.882008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5a22095f-151d-419f-9cc3-d88cafad0611 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.811538 Aug 24 04:59:39.895425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 14/27] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 04:59:38 2022] POST /compute/v2.1/servers => generated 403 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 04:59:39.901610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-aa289b8e-28f4-4124-a275-a30576136379 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde5f82dc10>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:40.058066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-aa289b8e-28f4-4124-a275-a30576136379 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 200 len: 345 microversion: 2.1 time: 0.160268 Aug 24 04:59:40.058801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 15/28] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:39 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:40.063596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9bc56766-54e2-4bae-8fc1-644128f26f9e tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:40.064450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9bc56766-54e2-4bae-8fc1-644128f26f9e tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:40.134753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a802a6e0-6ae6-44b2-8c27-c7f1a5dcef0b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.600820 Aug 24 04:59:40.142843 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 14/29] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 04:59:38 2022] POST /compute/v2.1/servers => generated 385 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 04:59:40.156149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-672467289", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa68ee2b-4e61-41de-a187-732b5be326be"}], "security_groups": [{"name": "tempest-securitygroup--1824938845"}], "key_name": "tempest-keypair-353147498", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:40.468716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9bc56766-54e2-4bae-8fc1-644128f26f9e tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:40.509195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9bc56766-54e2-4bae-8fc1-644128f26f9e tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1219 microversion: 2.1 time: 0.448989 Aug 24 04:59:40.525380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 16/30] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:40 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1219 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:40.531815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4b0bd52d-5a68-4cff-ae61-25602f573e65 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:40.543604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4b0bd52d-5a68-4cff-ae61-25602f573e65 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:40.617154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4b0bd52d-5a68-4cff-ae61-25602f573e65 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:40.627693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4b0bd52d-5a68-4cff-ae61-25602f573e65 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1244 microversion: 2.1 time: 0.099349 Aug 24 04:59:40.629038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 17/31] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:40 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:40.635415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a2f7acc1-8ae2-417f-8f4d-9e2646bae4c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:40.636405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a2f7acc1-8ae2-417f-8f4d-9e2646bae4c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:40.706015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] validate_networks() for [('fa68ee2b-4e61-41de-a187-732b5be326be', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:40.765042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a2f7acc1-8ae2-417f-8f4d-9e2646bae4c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:40.797463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a2f7acc1-8ae2-417f-8f4d-9e2646bae4c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1225 microversion: 2.1 time: 0.166358 Aug 24 04:59:40.798279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 18/32] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:40 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:40.896190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1242438852", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:41.013581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] validate_networks() for [('45b5889b-1fed-4157-a576-0b6107ddbe4e', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:41.893804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:41.894944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:41.897457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:41.899563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:41.899752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:41.928884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:41.929709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:41.930497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:41.931583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:41.932374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:41.933457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:41.966737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for project bd6824ae6edd43fcbddb58581134098c. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:41.973131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for user b11da4dac5804252b7310be096ae5d53 and project bd6824ae6edd43fcbddb58581134098c. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:41.998259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:42.004159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:42.219250 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3a6e4c5a-e673-43d9-b8c5-3e2a74933e50 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.075226 Aug 24 04:59:42.220030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 15/33] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 04:59:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 04:59:42.230330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eabbf1ae-305f-4318-94fd-01086c447a8b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde5f872f70>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:42.300228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-eabbf1ae-305f-4318-94fd-01086c447a8b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] HTTP exception thrown: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eabbf1ae-305f-4318-94fd-01086c447a8b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Request method failure captured: Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad HTTP/1.1 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAkEeMkVyEM9g-YSsPeUFwMyzuiKYgQ_ds1YTE7oatq5qwmPPuIX0Y6Xi8qX79fZEhZ4t0PjKuZNCCD75yOmHXut50ore_Vq3Fzcri6WXazWUrnZQ0jiZVXGKZpUJxqxbf5x1B9NTaibX9-X1yy_1mx3JaloHGIQrNPVH282q-ojg0 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 04:59:42.305575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_904b8da68db84c3ea1f8785c08ecdc58", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}] Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 00e30c4bef674af481586297243901db Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'd79183c6-cd81-4cd4-8075-082f9e2fa7ad'} Aug 24 04:59:42.306689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. (HTTP 404) (Request-ID: req-8c08a606-0144-4f36-9b7b-4cb453deba32) Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:42.307721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:42.308631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:59:42.309611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:42.314911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eabbf1ae-305f-4318-94fd-01086c447a8b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Returning 404 to user: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:42.321856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:42.321856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:42.322751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-eabbf1ae-305f-4318-94fd-01086c447a8b tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 404 len: 109 microversion: 2.1 time: 0.085004 Aug 24 04:59:42.322826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:42.322826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:42.322826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:42.323288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 16/34] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:42 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:42.326860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.329629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:42.329909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.330259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:42.330408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.331420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.333531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.334148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.363991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.365075 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.365538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.366683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.367469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.368701 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.378743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:42.388155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for user 51926dd0d6934aed907806a5cb14dc2f and project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:42.436106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:42.442643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:42.654932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:42.671586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-74b5e101-23be-4cb3-81a6-93e022af0028 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1215 microversion: 2.1 time: 0.350771 Aug 24 04:59:42.672168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 17/35] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:42 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1215 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:42.680035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:42.680893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:42.687704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.688203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.688670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.691409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:42.691895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:42.693278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:42.711225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-197e95ab-ccf3-461f-be9d-2125b3f3cdf2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.821061 Aug 24 04:59:42.712129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 19/36] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 04:59:40 2022] POST /compute/v2.1/servers => generated 385 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 04:59:42.719426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-370459669", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60f465a5-3648-4517-8cab-85b66f6fe49f"}], "security_groups": [{"name": "tempest-securitygroup--1475168068"}], "key_name": "tempest-keypair-2055917188", "user_data": "}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:42.823409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:42.837922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3a4a100a-171e-436f-acdd-08d722e9d799 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1248 microversion: 2.1 time: 0.161816 Aug 24 04:59:42.837922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 18/37] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:42 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1248 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:42.866868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-16feea29-60bf-43be-b294-a78ac97b7cbd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:42.873396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-16feea29-60bf-43be-b294-a78ac97b7cbd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:42.969149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-16feea29-60bf-43be-b294-a78ac97b7cbd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:43.009184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-16feea29-60bf-43be-b294-a78ac97b7cbd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1240 microversion: 2.1 time: 0.171830 Aug 24 04:59:43.009840 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 19/38] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:42 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:43.027371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac144763-c653-421d-81d1-e27d337bbc95 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde5e724700>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:43.061305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] validate_networks() for [('60f465a5-3648-4517-8cab-85b66f6fe49f', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:43.522545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-ac144763-c653-421d-81d1-e27d337bbc95 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] HTTP exception thrown: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac144763-c653-421d-81d1-e27d337bbc95 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Request method failure captured: Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad HTTP/1.1 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAkEeMkVyEM9g-YSsPeUFwMyzuiKYgQ_ds1YTE7oatq5qwmPPuIX0Y6Xi8qX79fZEhZ4t0PjKuZNCCD75yOmHXut50ore_Vq3Fzcri6WXazWUrnZQ0jiZVXGKZpUJxqxbf5x1B9NTaibX9-X1yy_1mx3JaloHGIQrNPVH282q-ojg0 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 04:59:43.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_904b8da68db84c3ea1f8785c08ecdc58", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}] Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 00e30c4bef674af481586297243901db Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'd79183c6-cd81-4cd4-8075-082f9e2fa7ad'} Aug 24 04:59:43.525749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. (HTTP 404) (Request-ID: req-9b455ef4-5436-4f17-b309-fb8682e7855f) Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.526816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:59:43.527833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:59:43.528752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac144763-c653-421d-81d1-e27d337bbc95 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Returning 404 to user: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:43.530933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac144763-c653-421d-81d1-e27d337bbc95 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 404 len: 109 microversion: 2.1 time: 0.514960 Aug 24 04:59:43.532751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 20/39] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 04:59:43 2022] DELETE /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 109 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:43.539621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b50cc18d-cf8c-4775-ba55-644930383e73 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:43.549615 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b50cc18d-cf8c-4775-ba55-644930383e73 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:43.701746 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b50cc18d-cf8c-4775-ba55-644930383e73 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:43.727228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b50cc18d-cf8c-4775-ba55-644930383e73 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1226 microversion: 2.1 time: 0.198268 Aug 24 04:59:43.739651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 21/40] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:43 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1226 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:43.760356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-82da9992-a745-4207-98c0-2b5bd1fe6153 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Calling method '.version_select at 0x7fde5e75bdc0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:43.873954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-82da9992-a745-4207-98c0-2b5bd1fe6153 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] HTTP exception thrown: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-82da9992-a745-4207-98c0-2b5bd1fe6153 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Request method failure captured: Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad HTTP/1.1 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAkEeMkVyEM9g-YSsPeUFwMyzuiKYgQ_ds1YTE7oatq5qwmPPuIX0Y6Xi8qX79fZEhZ4t0PjKuZNCCD75yOmHXut50ore_Vq3Fzcri6WXazWUrnZQ0jiZVXGKZpUJxqxbf5x1B9NTaibX9-X1yy_1mx3JaloHGIQrNPVH282q-ojg0 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 04:59:43.876350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_904b8da68db84c3ea1f8785c08ecdc58", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/904b8da68db84c3ea1f8785c08ecdc58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/904b8da68db84c3ea1f8785c08ecdc58"}]}] Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 904b8da68db84c3ea1f8785c08ecdc58 Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2014543155 Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 00e30c4bef674af481586297243901db Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2014543155-project Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'd79183c6-cd81-4cd4-8075-082f9e2fa7ad'} Aug 24 04:59:43.877759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. (HTTP 404) (Request-ID: req-24f46702-bb75-4fba-9f04-b3c75df62c48) Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.878636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:59:43.880731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:59:43.882159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-82da9992-a745-4207-98c0-2b5bd1fe6153 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] Returning 404 to user: Volume d79183c6-cd81-4cd4-8075-082f9e2fa7ad could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:43.883534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-82da9992-a745-4207-98c0-2b5bd1fe6153 tempest-VolumesSnapshotsTestJSON-2014543155 tempest-VolumesSnapshotsTestJSON-2014543155-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad" status: 404 len: 109 microversion: 2.1 time: 0.140034 Aug 24 04:59:43.884395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 22/41] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 04:59:43 2022] GET /compute/v2.1/os-volumes/d79183c6-cd81-4cd4-8075-082f9e2fa7ad => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:43.898497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:43.900411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:43.924165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:43.925850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:43.928298 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:43.929120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:43.931686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:43.933857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.064592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.070658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:44.071124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:44.071584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:44.071986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:44.072412 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:44.083445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bc204005-aac1-4e68-8966-218ed4997034 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1271 microversion: 2.1 time: 0.197900 Aug 24 04:59:44.090409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 23/42] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:43 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:44.108808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.113034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:44.116872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.117615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.118669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.121414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.122414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:44.123144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.139272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.142782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.143564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.144516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.145228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.146025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.160100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for project d373da7992054abfae0564708529a973. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:44.164765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for user 842e7dea2bb24389b900d29351a0bd33 and project d373da7992054abfae0564708529a973. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:44.178213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:44.181422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:44.245325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.257346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-64fe44be-a536-4a0a-9762-2c21f56dc667 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1296 microversion: 2.1 time: 0.152768 Aug 24 04:59:44.258610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 24/43] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:44 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:44.264071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:44.269468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:44.272155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.272982 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.273647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.274556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.275163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.275993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.382951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8b279c86-683d-4eb7-988b-8b99c150705d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.669324 Aug 24 04:59:44.390745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 20/44] 10.222.0.105 () {62 vars in 1193 bytes} [Wed Aug 24 04:59:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 04:59:44.397893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:44.398768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:44.403693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.415750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-107b6b87-b86b-49ae-8fab-be7b704fd90f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1244 microversion: 2.1 time: 0.153946 Aug 24 04:59:44.439339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 25/45] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:44 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1244 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:44.472161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.484005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.486666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.488133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a586f680-e1d9-43a9-9f99-9d924d445c4a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1285 microversion: 2.20 time: 0.096005 Aug 24 04:59:44.503045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 21/46] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:44 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:44.753885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:44.756861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:44.766688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.767445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.768045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.769474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:44.771040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:44.771934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:44.899047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:44.929109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0e405647-781e-41e3-bf6a-6afb309aa058 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1230 microversion: 2.1 time: 0.181069 Aug 24 04:59:44.930326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 26/47] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:44 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1230 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:45.119327 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.119953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.156150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.159702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.163655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.168240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.183686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.184653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.279314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.279963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.291289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.291796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.292239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.305902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.306740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.309181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.646953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.648552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.671361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8b1f9711-ef96-4537-9cb6-9c204544b6bd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1304 microversion: 2.1 time: 0.395975 Aug 24 04:59:45.675741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 27/48] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1304 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:45.679769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7c1ef47a-8819-4d77-a5ed-d3ddd967ffba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1277 microversion: 2.1 time: 0.571433 Aug 24 04:59:45.684977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 22/49] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1277 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:45.688963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.689976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.698441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.699096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.714391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.714888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.725208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.727782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.728274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.728720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.785146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.802907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.806395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.807993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b8e63241-3cc5-4bca-bcc6-2d0150838afd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1285 microversion: 2.20 time: 0.123725 Aug 24 04:59:45.809705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 23/50] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:45.940028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:45.951518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:45.952426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:45.962590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.967053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.967635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:45.968456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-745cd5c7-5e60-4d90-a4d5-0d8fcdd7ad9f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1292 microversion: 2.1 time: 0.273531 Aug 24 04:59:45.968829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:45.969374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:45.970066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 28/51] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1292 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:45.984472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.152545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:46.165335 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3c87a7c1-fd4b-469a-aeb6-dba88a1f3b2d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1278 microversion: 2.1 time: 0.215477 Aug 24 04:59:46.168450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 24/52] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:45 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:46.698285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:46.699204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:46.701417 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:46.702255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:46.702831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:46.712574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.713060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.713655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.714505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.714619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.714999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.715307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.715733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.715949 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:46.716805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:46.727776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:46.728233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.424716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.449171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7a0d347d-99dc-4e7f-8bdb-841392da0ecc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1302 microversion: 2.1 time: 0.752461 Aug 24 04:59:47.465876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 29/53] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:46 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1302 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:47.493195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:47.494593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:47.514021 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.517044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.517837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.519463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.523559 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.524253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.870775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.880925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.890536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:47.891720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-af7e958d-a12f-43a8-a35c-40af3db2c03e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1337 microversion: 2.20 time: 0.424796 Aug 24 04:59:47.892283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 30/54] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:47 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1337 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:47.907849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:47.912729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:47.932379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.939787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.940417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.941188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.943883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.948723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.338841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.374623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4b355953-d00d-4871-9c01-fd3594e7f799 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 1.654961 Aug 24 04:59:48.377494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 25/55] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:46 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:48.384302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:48.384933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:48.419638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.422364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.424345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.425139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.425626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.429679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.546104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.556050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d1b3d50-e882-47d7-a8b0-82389c935540 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1298 microversion: 2.1 time: 0.662716 Aug 24 04:59:48.557711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 31/56] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:47 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1298 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:48.564181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:48.565013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:48.576758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.579268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.579984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.585089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.585089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.585089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.888437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.907444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f2601621-c5c1-43c0-8827-fb88999301fa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1302 microversion: 2.1 time: 0.340742 Aug 24 04:59:48.908070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 32/57] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:48 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1302 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:48.909887 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:48.921547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:48.925175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:48.929542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a70a4719-795c-4d81-acab-0732274a3b82 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1284 microversion: 2.1 time: 0.550852 Aug 24 04:59:48.932402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 26/58] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:48 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1284 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:48.961069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.961069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.961069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.961069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.961609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.961609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.126008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:49.139351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:49.140871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:49.141995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ad68a1bc-63e4-480c-9e4f-102a4f72c154 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1345 microversion: 2.20 time: 0.225468 Aug 24 04:59:49.142545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 33/59] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:48 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:59:49.398317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.400220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.416588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.420728 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.423251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.432146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.433738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.437769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.581570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.605186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.621180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.622656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.623294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.624231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.629317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.630284 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.906542 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:49.923964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d7abbb2-15cb-4b3c-83e2-0784b317a387 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1298 microversion: 2.1 time: 0.345180 Aug 24 04:59:49.934670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 34/60] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1298 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:49.963853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.963853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.990860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.002865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.018744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.021952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.028837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.029347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.216289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.226925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0e27ccf7-8b48-4933-8b13-faf888fd2679 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.833011 Aug 24 04:59:50.242548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 27/61] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:50.250952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:50.252258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:50.273460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.274600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.275244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.276146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.276818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.298790 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.299169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.308544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-536c1e8d-dd14-4140-b1c7-9b55f419e4ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1302 microversion: 2.1 time: 0.372474 Aug 24 04:59:50.309609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 35/62] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:49 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1302 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:50.318975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:50.319821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:50.327990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.328813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.329806 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.330850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.331730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.333076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.362309 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:50.500988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.506683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-65cc84a6-133b-4bac-b70c-a5b34bfedb27 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1284 microversion: 2.1 time: 0.262432 Aug 24 04:59:50.507966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 28/63] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:50 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:50.535815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.548654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.552009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:50.558507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-909ebe7c-3b51-4daa-b51f-7309c78419f8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1343 microversion: 2.20 time: 0.242472 Aug 24 04:59:50.558507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 36/64] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:50 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:50.953312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:50.954000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:50.962835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.967586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.967586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.967586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.967586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.967917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.090118 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:51.098729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-11dd8c68-9391-4b71-bb00-259411343b93 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1298 microversion: 2.1 time: 0.150030 Aug 24 04:59:51.099348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 29/65] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:50 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:51.251514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:51.254386 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:51.270797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.274237 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.276258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.286495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.287279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.297857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.345896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:51.347549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:51.355718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:51.391166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.392912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.393965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.403473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.404298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.404988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.950852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:52.005692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.021103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d927f193-5ed6-4bc7-9649-2f8021542a94 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.776261 Aug 24 04:59:52.034391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 37/66] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:51 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:52.046675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.046675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.059910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.060423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.063883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.065901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.072093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.075089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.137898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.152077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d2f9b078-70ab-4aca-9417-f8a244bc9e71 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.818625 Aug 24 04:59:52.153238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 30/67] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:51 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:52.168836 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.175928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.182712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.192154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.192938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.196186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.197005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.198336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.408676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.425681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.427450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.428620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3fce910-61be-4c09-8175-62758e18781b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1343 microversion: 2.20 time: 0.274214 Aug 24 04:59:52.429212 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 31/68] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:52 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1343 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:52.436843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.437521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.449969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.450534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.451092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.466065 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.466941 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.467769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.626020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.639874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e8f3b162-9f2d-45fa-891c-cb9829cd6986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1298 microversion: 2.1 time: 0.209553 Aug 24 04:59:52.640539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 32/69] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:52 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:52.790509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:52.808300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e5fd97ad-49fa-4a2c-aeb9-1adc42f51e3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.772412 Aug 24 04:59:52.809241 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 38/70] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:52 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:53.043595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:53.044693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:53.059085 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.062732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.063329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.074754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.074754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.074754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.187834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:53.189039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:53.200560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.207578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.212672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.213522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.214630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.216948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.723665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=30 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:54.142915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:54.417200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.436265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-aad9d630-c1ee-43e6-aa76-42d56ae807c7 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 1.395731 Aug 24 04:59:54.437843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 33/71] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:53 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:54.453029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.466412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6a5712cb-da74-466b-9f03-65fe388370b4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 1.282881 Aug 24 04:59:54.468585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 39/72] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:53 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:54.470162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:54.474041 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:54.475531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:54.476306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:54.484747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.485432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.486071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.487048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.487182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.488420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.488569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.489044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.489579 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.490527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.491093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.491685 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.698808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.711586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.713135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:54.714259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1322052e-6d0f-46c8-b07d-3d88ff304705 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1343 microversion: 2.20 time: 0.273607 Aug 24 04:59:54.715008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 34/73] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:54 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1343 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:54.750614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:54.751831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:54.772151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.772727 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.773232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.775479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.776098 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.778886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.023457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:55.032105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-997a99f3-ef64-48f2-9dc3-24bde50d9fb2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.561946 Aug 24 04:59:55.046771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 40/74] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:54 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:55.092519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:55.103194 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ff6fba33-fe1a-46fe-81a0-af6a903d1864 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.370120 Aug 24 04:59:55.104366 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 35/75] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:54 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:55.337276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafe7c72-03ed-4290-b32a-f2ea4cea4b5b", "tag": "7d5c8ebf-0828-4896-8dfd-0ddc4b429c21"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:55.374096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.374582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.375076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.443408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Creating event network-changed:7d5c8ebf-0828-4896-8dfd-0ddc4b429c21 for instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b on hv-cinder-85426 Aug 24 04:59:55.448304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:59:55.449022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-94e11c73-123f-4059-877d-b086d6f698a8 req-985815b8-8ee7-483c-9627-86a99a9265cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=122277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:59:55.451316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.457295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.458779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.459775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.460395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.464608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.470015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:55.470890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:55.488594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.compute.rpcapi [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:59:55.492157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=122277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:59:55.518703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.521296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.526620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.535862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.536047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1530e0b8-fd7a-4b26-b082-1bfd26a425a9 None None] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.486405 Aug 24 04:59:55.537296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.537296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.538210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 41/76] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 04:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:55.583222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:55.591093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:55.623583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.624330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.627333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.629577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.636763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.639395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.796248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=32 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:56.118477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.129463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2650e34b-1eb1-4be0-a172-91d9aa972864 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.670649 Aug 24 04:59:56.133570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.155955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 36/77] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:55 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:56.167329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-545c5849-e1a3-447b-a9fd-0bde1caa004b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.627048 Aug 24 04:59:56.184829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 42/78] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:55 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:56.192867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.194352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.225765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.231162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.232572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.235538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.236038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.239920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.317494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ffd41-8ca1-4080-bf08-dfb4e18d93af", "tag": "fd702a10-383b-4b70-aecf-908548494e62"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:56.338457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.339011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.339478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.352971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] Creating event network-changed:fd702a10-383b-4b70-aecf-908548494e62 for instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af on hv-cinder-85426 Aug 24 04:59:56.365176 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-03976e43-a76e-408a-b0ee-0f8e4f820bcf req-66570f67-ba9c-4d85-ac95-63c4c098ca4d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177340 Aug 24 04:59:56.375378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 43/79] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 04:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:56.386910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.387858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.396199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.397244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.398485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.399425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.400346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.400979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.858510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.865836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-91d37fcc-bc90-4989-8824-fdcd837e7aa6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.488285 Aug 24 04:59:56.866420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 44/80] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:56 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:56.887427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:56.888059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:56.918830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.918830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.918830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.928653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.929202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:56.930234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:56.930234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:56.950726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.955256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:56.980923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9d54e4fd-9488-4000-a2b3-20388399e698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.823245 Aug 24 04:59:56.982529 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 37/81] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:56 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:57.184939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:57.186593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:57.204158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:57.205059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:57.207599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:57.207599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:57.207599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:57.209907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:57.217953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:57.233676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:57.252088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-645a8048-c1f3-4427-a832-42e063bb3b18 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.379419 Aug 24 04:59:57.253036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 45/82] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:56 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:57.258216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:57.259097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:57.278981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:57.279691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:57.282166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:57.283139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:57.283614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:57.284064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.217892 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.229982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-df336e67-60d9-411f-8942-d83de41b4cb9 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 1.055362 Aug 24 04:59:58.232702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 38/83] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:57 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:58.251432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.265247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:58.270897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:58.272081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-961426d5-8afe-4bbb-ab87-e6eb6338829a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 1.012571 Aug 24 04:59:58.275444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 46/84] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:57 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:58.296642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:58.296642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:58.297493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.297493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.297493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.297493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.298015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.298099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.298180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.298260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.298348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.298348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.298348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.298348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.556209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.567519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.573294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.578105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1a109366-eeca-46bd-8631-f29b3b75a6ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.301461 Aug 24 04:59:58.580207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 47/85] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:58 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:59:58.594988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:58.597271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:58.610991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.612630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.613268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.614365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.615537 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.616320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.644486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.653599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-73552026-14c4-4fe7-a835-a96eebd0897c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.418226 Aug 24 04:59:58.654868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 39/86] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:58 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:58.686060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6825c-7456-4e46-8158-e15a11ced942", "tag": "3b8866d6-c018-428f-b34a-771e00bb44a7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:58.732253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.734984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.736560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.778171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Creating event network-changed:3b8866d6-c018-428f-b34a-771e00bb44a7 for instance 13e6825c-7456-4e46-8158-e15a11ced942 on hv-cinder-85426 Aug 24 04:59:58.780373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:59:58.781799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-6d55fd8c-3d63-408b-9b56-15e9f3269c06 req-73d51783-d7d3-43fe-a5c7-32f62ad1c650 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:59:58.783405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.786405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.788166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.791818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:58.794208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:58.795449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:58.841736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.compute.rpcapi [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:59:58.848482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] Releasing lock "compute-rpcapi-router" {{(pid=122276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:59:58.900422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bd620d73-d4da-4545-abe5-30004f5f607f None None] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237287 Aug 24 04:59:58.902701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 40/87] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:58.979427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:58.994213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2090dde5-b63c-4aa7-962d-63fd7f2c904d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.401568 Aug 24 04:59:59.014292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 48/88] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:58 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:59.260631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:59.262128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:59.287804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.290003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.292460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.296421 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.298200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.302379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.305323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:59.306370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:59.331247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.334807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.338318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.339409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.340186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.348900 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.813173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:59.821941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-29243106-9b30-46a9-af29-3bafc068b297 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.520782 Aug 24 04:59:59.837198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:59.849974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 49/89] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:59 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:59.859454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-364522fc-2091-478c-869a-09bcff590b9c tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.608605 Aug 24 04:59:59.862476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 41/90] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:59 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:59.867173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:59.868868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:59.878895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:59.880012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:59.891445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.892369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.893019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.894588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.896050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.896940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.898128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.898729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.902319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.903412 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.904859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.907825 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.302104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.312841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.320585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.343695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7fb2273a-05f5-4383-bf3d-5a3f111274ae tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.476069 Aug 24 05:00:00.343695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 50/91] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 04:59:59 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:00.354952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:00.354952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:00.357137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.359713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.361369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.365105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.365851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.366528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.412729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.423304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b513016c-4c9b-4b92-8a76-3aa8e0dac209 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.559391 Aug 24 05:00:00.427627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 42/92] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 04:59:59 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:00.606285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.628729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-27123269-d425-463b-93c7-71bd02e2cd6f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.296263 Aug 24 05:00:00.642588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 51/93] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:00 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:00.853964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:00.854588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:00.861468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.863009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.863479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.864350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.864960 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.865395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.882217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:00.883256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:00.890029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.890519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.890960 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.891695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.892154 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.892609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.108987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.119169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4a1a946c-b8db-458a-a3aa-650baf0d8190 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.268754 Aug 24 05:00:01.119564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 43/94] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:00 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:01.136831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "676b64f6-0ef9-4250-8e40-a7c922046984", "tag": "936c85cd-1e05-4281-b3e6-13b1c7718075"}, {"name": "network-changed", "server_uuid": "6f4225d1-b115-4951-a361-2118e0bf3022", "tag": "8a56cc43-f19d-4e76-ba1f-7968609999dd"}, {"name": "network-changed", "server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:01.151344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.151900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.152403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.152522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.160714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7d5eb76a-5308-4203-9b79-22a54808171f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.282817 Aug 24 05:00:01.161292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 52/95] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:00 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:01.166710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Creating event network-changed:936c85cd-1e05-4281-b3e6-13b1c7718075 for instance 676b64f6-0ef9-4250-8e40-a7c922046984 on hv-cinder-85426 Aug 24 05:00:01.167253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Creating event network-changed:8a56cc43-f19d-4e76-ba1f-7968609999dd for instance 6f4225d1-b115-4951-a361-2118e0bf3022 on hv-cinder-85426 Aug 24 05:00:01.167750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] Creating event network-changed:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:00:01.176196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-bd864ef1-8e11-4fca-bcd5-f5f8ab9c087b req-6ecb35fe-64de-47dc-badb-b816c564fa52 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.055351 Aug 24 05:00:01.176798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 44/96] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:01.372121 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:01.372656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:01.379924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.380415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.380859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.381564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.382021 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.382458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.450542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:01.451998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:01.465094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.465664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.466234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.467072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.467594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.468106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.561757 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.570933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.576655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.577801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0eb45e33-38bd-4ec9-b652-a69c2f584225 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.209694 Aug 24 05:00:01.578366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 53/97] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:01 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:01.623814 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.631785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-77eeb97a-a80d-4adb-820a-c32a760918ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.185654 Aug 24 05:00:01.632521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 45/98] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:01 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:01.650450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:01.651135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:01.657113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.657598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.658039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.659424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.659888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.660316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.664717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:01.788607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.796165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d8620e8e-3e32-4102-9e7d-56ca7541ffe8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.149672 Aug 24 05:00:01.796927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 54/99] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:01 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:02.139959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.140765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.147314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.148001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.148592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.149442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.150332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.150918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.182102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.182723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.194533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.195062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.195894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.196457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.197397 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.197397 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.446057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.451303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.454245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-26454cf1-0d06-42f8-ad6e-fe2172bce3ac tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.318086 Aug 24 05:00:02.455229 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 46/100] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:02.460103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-129dbc9e-f449-4977-bef2-a4adc6965c28 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.282902 Aug 24 05:00:02.469027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 55/101] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:02.601926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.602638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.611619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.612730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.613348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.614372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.615072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.616205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.669169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.669169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.669169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.669169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.669477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.669477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.669871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.672104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.843377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.853268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.854915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.856122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2c125766-f88c-44ec-813b-f84926a38e67 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.258155 Aug 24 05:00:02.869763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 47/102] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:02.869763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.869763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.870226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:02.870333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.870333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.870333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.870578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.870819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.871287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.877046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f92121a0-5106-4df3-8fbe-8a3e55ff1aa4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.227423 Aug 24 05:00:02.878239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 56/103] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:03.008532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:03.016305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-57a6cd22-40f1-47c5-a1d8-036a5420ad29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.158336 Aug 24 05:00:03.016871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 48/104] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:03.482375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:03.482886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:03.484103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:03.484422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:03.492665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.493199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.493635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.494151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.494484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.495126 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.495652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.495874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.496278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.503248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.504131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.504832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.807945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:03.812436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:03.819844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f33c6db3-9bc7-4801-a7c3-15a7066ff046 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.342928 Aug 24 05:00:03.820698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 49/105] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:03 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:03.822215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8dcbe656-2a6e-4169-9d55-cfaf382399c8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.347664 Aug 24 05:00:03.828113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 57/106] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:03 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:03.882120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:03.882746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:03.891220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.891706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.893930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.893930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.894105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.894422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.899194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:03.899809 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:03.905909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.906395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.906953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:03.907561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:03.908017 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:03.908657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.285930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:04.294102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:04.295274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:04.296975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:04.298807 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-277299be-d3fa-4a6b-9a36-f906c240ad43 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.422062 Aug 24 05:00:04.300217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 50/107] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:03 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:04.302566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9d965d9f-6be4-4f39-b622-fe422ba470fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.407372 Aug 24 05:00:04.306107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:04.306938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:04.313557 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.314255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.314847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.315853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.316276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 58/108] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:03 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:04.316410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.316828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.451371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:04.460399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c6550d57-f032-4c87-a907-c1966caa49ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.158821 Aug 24 05:00:04.461206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 51/109] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:04 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:04.841601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:04.842838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:04.845395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:04.846570 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:04.849211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.850348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.850796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.851511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.852156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.852593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.853636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.854235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.854741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:04.855565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:04.856230 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:04.856720 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.056609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.059809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.066400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-aadd4ebf-0240-4471-b98b-76c050538cad tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.228635 Aug 24 05:00:05.066976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 59/110] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:04 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:05.068829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-abdbec5d-5101-4432-aaab-a12ed87defcd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.227080 Aug 24 05:00:05.069498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 52/111] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:04 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:05.322453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:05.323231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:05.329808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:05.329997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.330752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.331074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:05.331396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.332124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.332576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.333196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.347818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.348378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.348952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.350180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.351011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.351804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.478040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:05.554925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.554925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.556375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.557466 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0e58b87d-086c-42b9-9fb4-ac9f62b45ae0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.239590 Aug 24 05:00:05.558014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 60/112] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:05 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:05.558524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.562315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:05.562915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:05.567843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-80918b09-da20-49e9-890e-97aca1501026 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.245766 Aug 24 05:00:05.579036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 53/113] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:05 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:05.579164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.579164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.579164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.579164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:05.579463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:05.579463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:05.700169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:05.708127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7dc82ef0-1f8e-45e8-b85b-397ed7b816c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.149185 Aug 24 05:00:05.708770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 61/114] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:05 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:06.087703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:06.088425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:06.094124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:06.094630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.094742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:06.094898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.095379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.096861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.097389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.097849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.101766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.102254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.103064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.103434 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.103893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.104321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.311219 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.312130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.321004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f2c53fa-a736-49a4-9e22-eb1e928c0cf8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.237878 Aug 24 05:00:06.321155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-08f3dc42-4fc5-4df3-b590-8d191ef3c565 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.230979 Aug 24 05:00:06.322091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 62/115] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:06 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:06.322514 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 54/116] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:06 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:06.580454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:06.581063 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:06.586997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.587514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.587947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.588630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.589081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.589503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.590146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:06.590762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:06.597231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.597721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.598163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.598860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.599385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.599828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.828159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.835407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.843006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.843806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cdf560f0-fa62-4242-9aaf-43e423508f6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.257008 Aug 24 05:00:06.844401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 55/117] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:06 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:06.844602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:06.847586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac333873-2d7c-4370-bec5-0aa0076dddf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.269276 Aug 24 05:00:06.850695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 63/118] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:06 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:06.850820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:06.851216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:06.857439 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.860218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.860218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.860218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:06.860218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:06.860508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:06.865209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:07.000290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:07.008489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1a6d2c0c-819e-4f1d-b45c-0fd0466fe54d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.162596 Aug 24 05:00:07.009073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 56/119] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:06 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:07.342148 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:07.342672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:07.343089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:07.343169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:07.349239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.349733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.350091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.350199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.350596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.350852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.351212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.351316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.351747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.351910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.352549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.352979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.554226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:07.562174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e3a315ee-3791-4900-99a3-521bc90e7312 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.224344 Aug 24 05:00:07.563134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 64/120] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:07 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:07.565911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:07.575111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-87942547-83ec-4be5-9b12-311a5b370009 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.235260 Aug 24 05:00:07.583211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 57/121] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:07 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:07.865310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:07.866149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:07.871626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:07.872174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.872296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:07.872666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.873103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.873810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.874274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.874708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.879117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.879617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.880077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:07.880821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:07.881337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:07.881778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.095482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.107371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.117567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.123782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.125177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8fd71e20-8b3b-42ee-aea8-1ec43b48cb1a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.257818 Aug 24 05:00:08.125940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-24ca7dda-833b-4af8-ba4d-58bc91c62fd6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.261364 Aug 24 05:00:08.126651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 65/122] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:07 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:08.135165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 58/123] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:07 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:08.144302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:08.144939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:08.151922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.152441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.152889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.153600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.154069 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.154499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.306179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.315808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6952f980-1a33-4caa-8d50-a12a91f80704 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.179432 Aug 24 05:00:08.316393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 59/124] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:08 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:08.584837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:08.585443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:08.591357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.591771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.592200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.593054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.593502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.593922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.596110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:08.596859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:08.602843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.603577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.604022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.604725 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:08.605185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:08.605612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:08.791083 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.800360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5f493437-6d00-45d0-8d41-05cc3198cec4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.220503 Aug 24 05:00:08.800482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:08.800936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 66/125] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:08 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:08.824060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0ad31a80-e7d2-4a17-a4aa-79faef528b95 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.232370 Aug 24 05:00:08.825914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 60/126] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:08 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:09.148618 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:09.149454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:09.157949 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:09.158507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.158618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:09.159466 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.159998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.160804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.161360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.161844 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.164394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:09.166761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.167466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.168257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.168992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.169614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.170076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.407635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:09.416892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f69c4783-e3ac-4b53-b023-d8fd4a31db2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.273278 Aug 24 05:00:09.426872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 67/127] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:09 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:09.433580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:09.434381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:09.443276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.443905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.444508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.445561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.446142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.446790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.464934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:09.476828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:09.478561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:09.479895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-de5eafd1-bee3-41bf-9341-2e6fcb65aed7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.328985 Aug 24 05:00:09.480756 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 61/128] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:09 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:09.600035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:09.608333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-07e51f09-b0ef-4932-be43-9b236c3d3b36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.180025 Aug 24 05:00:09.623202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 68/129] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:09 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:09.820949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:09.821778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:09.828373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.829029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.829572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.830342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.830673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ffd41-8ca1-4080-bf08-dfb4e18d93af", "name": "network-vif-plugged", "status": "completed", "tag": "fd702a10-383b-4b70-aecf-908548494e62"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:09.833390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.833928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.844472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.845136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.848866 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.864750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] Creating event network-vif-plugged:fd702a10-383b-4b70-aecf-908548494e62 for instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af on hv-cinder-85426 Aug 24 05:00:09.871386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-1834b120-027d-4427-b98f-46d1fac1fb3e req-dafd7ec7-db06-46b4-aa90-3a18302fd320 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102516 Aug 24 05:00:09.875572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 62/130] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:09.882430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:09.883436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:09.892413 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.893241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.893972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:09.894879 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:09.895384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:09.895812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.031434 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.039710 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b179a513-00e0-455c-b93b-3a94f8e40aa5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.222595 Aug 24 05:00:10.040290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 69/131] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:09 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:10.059591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.067580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f3d824d8-3367-414f-8d92-41adddcc8dfd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.190508 Aug 24 05:00:10.068144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 63/132] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:09 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:10.437603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:10.438254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:10.444481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.444968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.445402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.446306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.446770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.447230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.504123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:10.504992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:10.511129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.511615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.512075 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.512934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.513389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.513816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.621940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.625390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:10.631070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-887cdb28-2657-46c2-bbf4-8e14ab5f709b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.197256 Aug 24 05:00:10.631821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 70/133] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:10 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:10.649734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:10.650338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:10.656361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.657035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.657659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.658360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:10.658997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:10.659599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:10.671930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.696513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.698200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.699347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3c12925a-ef24-4323-9be2-ab6a7e6a6a6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.200161 Aug 24 05:00:10.699908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 64/134] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:10 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:10.798621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:10.807499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7729bef9-efe9-4bf7-9634-12efa4012b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.162694 Aug 24 05:00:10.808067 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 71/135] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:10 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:11.060812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:11.061442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:11.067776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.068262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.068697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.069384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.069841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.070299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.089871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:11.090643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:11.097762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.098244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.098676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.099403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.099852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.103496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.263649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.272224 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-13387159-2497-4eac-a38e-ff73e623bddc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.215276 Aug 24 05:00:11.272816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 65/136] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:11 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:11.275201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.282842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-82d45848-bdab-4637-bb74-9b2a150d708d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.198209 Aug 24 05:00:11.283424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 72/137] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:11 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:11.654793 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:11.655428 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:11.661879 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.662359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.662788 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.663499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.663952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.664373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.722794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:11.724247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:11.730763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.731392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.731930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.732727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.733252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.733799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.841698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.850951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-eb3f7454-8ed2-4d3b-b4cc-992ba253c6d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.199943 Aug 24 05:00:11.853947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 66/138] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:11 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:11.864440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:11.864440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:11.866822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.867532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.867980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.868691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:11.869251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:11.869841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:11.890291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.899425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.901180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:11.902440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7d937dfb-e555-4733-9175-718b0425463f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.183916 Aug 24 05:00:11.902990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 73/139] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:11 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:12.011981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:12.023110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d9cb9606-de39-4a15-8936-b047b7634eba tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.167495 Aug 24 05:00:12.023110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 67/140] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:11 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:12.292359 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:12.292965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:12.298978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.300847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.301035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.301698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.302154 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.302658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.309334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:12.310498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:12.316852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.317334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.318053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.318760 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.319248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.319853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.507958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:12.512592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:12.516557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ee26b828-1ed2-4821-b01f-743fc59abda2 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.227839 Aug 24 05:00:12.519060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 74/141] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:12 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:12.522368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-68b1c767-1d14-4acf-b0e1-7ac0f6796491 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.217751 Aug 24 05:00:12.523341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 68/142] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:12 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:12.878914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:12.879580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:12.885569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.886046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.886558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.887285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.887747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.888170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.925132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:12.925767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:12.932496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.933026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.933469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:12.934174 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:12.934660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:12.935703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.088686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.098891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-44665e71-0bd7-4d7f-bb0d-3f470f328848 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.224395 Aug 24 05:00:13.111055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 75/143] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:12 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:13.111055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:13.111055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:13.113485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.114588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.114588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.115171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.115296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.115693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.116109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.123380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.124888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.126006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f46828ea-9d8d-43d6-9518-ff49b293ba73 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.204728 Aug 24 05:00:13.126564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 69/144] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:12 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:13.246616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.255180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-007031ce-93e0-4ff4-b52c-cd624317744e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.153906 Aug 24 05:00:13.266085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 76/145] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:13 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:13.538231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:13.538868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:13.545244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.545734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.546167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.546863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.547347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.547870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.548656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:13.549545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:13.556022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.556586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.557093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.557867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.558406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.558898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.740102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.748430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-050c93c5-1fc1-4d62-86cd-b4805567e86b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.214337 Aug 24 05:00:13.749069 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 70/146] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:13 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:13.750997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:13.760558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bb395195-feb7-40a5-a65d-e99ce6b904f6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.216679 Aug 24 05:00:13.761151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 77/147] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:13 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:14.121165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.121762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.128526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.129007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.129443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.130132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.130592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.131035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.149823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.150462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.156477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.156985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.157428 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.158119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.158585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.159013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.335012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.337959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.343084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9766178f-91fb-42cf-861e-1c20681e5a84 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.225867 Aug 24 05:00:14.343661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 71/148] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:14.349511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.350184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.350433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.352188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.353433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-74c427e9-779b-404c-a11e-7c3b611768b7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.207625 Aug 24 05:00:14.354053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 78/149] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:14.356569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.357117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.357564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.358265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.358771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.359214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.488784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.496507 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5329ad9a-c8d2-4cea-a9fe-13a7091656b6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.151845 Aug 24 05:00:14.497083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 72/150] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:14.770095 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.770693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.773687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:14.776997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.777468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.777910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.778591 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.779062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.779488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.782032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.782913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.789247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.789926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.790433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.791257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:14.791782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:14.792276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:14.812677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:14.989213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.990633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.999422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-690cbb42-60a9-4eb3-9d53-81b46702b75f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.221472 Aug 24 05:00:15.009508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 73/151] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:15.009645 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-51928e4e-0d3d-49bb-99ab-dd6e0853ab79 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.236054 Aug 24 05:00:15.009645 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 79/152] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:15.365643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:15.366339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:15.372899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.373397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.374202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.374542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.374998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.375453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.377267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:15.380006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:15.386509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.387000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.387458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.389260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.389260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.389260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.580232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.584913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.589306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8db8bc89-14ae-4e55-aab1-24607fe5a874 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.228645 Aug 24 05:00:15.601517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 74/153] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:15 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:15.601690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.601814 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:15.601903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.601985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:15.602056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c00b09e2-5dad-4674-bef8-2b316e64ca53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.223784 Aug 24 05:00:15.602056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 80/154] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:15 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:15.603473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.603975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.604419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.605121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.605577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.606190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.747741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.756244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-86ca86de-62fa-44df-8a84-1fee7e01cd17 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.165284 Aug 24 05:00:15.757003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 75/155] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:15 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:16.022275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.022943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.024340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.025045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.029071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.029561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.029997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.030689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.031040 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.031194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.031531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.031628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.031960 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.032640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.033089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.033573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.405285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.409573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.413568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0ef5671d-bfdc-478f-b1dc-6ad73846be8e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.395591 Aug 24 05:00:16.414138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 81/156] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:16.417129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ff231253-4f5a-4552-83f8-6a684b45adbc tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.396761 Aug 24 05:00:16.417688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 76/157] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:16.612872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.613476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.619582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.620070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.620500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.621186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.621634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.622102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.622692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.623396 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.630243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.630722 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.631195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.631885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.632346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.632767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.813202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.821255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-44c47ce8-fa27-4fbc-a19f-318dc83a7ccc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.212596 Aug 24 05:00:16.821372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.822102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 82/158] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:16.826569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.827222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.834383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.834876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.835363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.836199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.836663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.837094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.839209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.842766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.843862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-20ba8e2e-8f6c-4a97-9fcd-cfc58e1924b9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.224942 Aug 24 05:00:16.844649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 77/159] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:16.975765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.987269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c7b34d26-137b-493b-9834-72ec1f5ace9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.160524 Aug 24 05:00:16.987269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 83/160] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:17.435658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:17.436280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:17.437370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:17.437981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:17.443260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.443778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.444219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.444600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.444916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.445086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.445401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.445521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.445852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.446207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.446666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.447123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.646718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:17.649999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:17.654722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-489a2baa-bb7d-49b3-96d6-4e62709854a1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.221080 Aug 24 05:00:17.655322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 84/161] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:17 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:17.657856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5dae4f07-9aa5-446a-b215-467dc2e1de3f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.226088 Aug 24 05:00:17.658509 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 78/162] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:17 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:17.842481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:17.843113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:17.849042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.849527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.849959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.850650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.851147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.851572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.867550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:17.868288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:17.874058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.874568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.875000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.875708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.876158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.876579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.041765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.049972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-49b5b6b5-c299-48e5-be7b-bdf3adf5f193 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.210772 Aug 24 05:00:18.050538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 85/163] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:17 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:18.055221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:18.055839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:18.059877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.061487 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.062129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.062569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.063304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.063761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.064192 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.068945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.070523 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.071674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7a79f23e-737b-4afc-884e-800069cc5719 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.208087 Aug 24 05:00:18.072242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 79/164] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:17 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:18.197391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.204961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9bc9477c-b309-4ea0-8d25-942308e767e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.153469 Aug 24 05:00:18.205709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 86/165] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:18 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:18.676456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:18.677076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:18.679792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:18.680766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.680870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:18.684247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.684782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.685248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.685982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.686445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.686874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.688041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.688474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.688920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.689996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.690759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.692630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.711372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.899858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.905039 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:18.908030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-69a29884-692e-4b1b-9f71-b7becafc2c6a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.232492 Aug 24 05:00:18.908973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 87/166] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:18 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:18.926168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-32cb4399-5ecc-4793-80b6-cd821ea0745f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.254085 Aug 24 05:00:18.926754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 80/167] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:18 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:18.952134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e6825c-7456-4e46-8158-e15a11ced942", "name": "network-vif-plugged", "status": "completed", "tag": "3b8866d6-c018-428f-b34a-771e00bb44a7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:18.963310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.963790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.964236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.975953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] Creating event network-vif-plugged:3b8866d6-c018-428f-b34a-771e00bb44a7 for instance 13e6825c-7456-4e46-8158-e15a11ced942 on hv-cinder-85426 Aug 24 05:00:18.981467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-dd40d0f1-1166-4743-92f1-0e8fb44e9aee req-771aba21-72e3-4604-a5d7-c02a7d90cd74 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Aug 24 05:00:18.982064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 88/168] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:19.071621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.072261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.078301 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.078784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.079255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.079950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.081741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.082355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.094714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.097179 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.103137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.103636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.104449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.105170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.105631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.106060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.287553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.296249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f9ee7227-c05b-4d05-959c-e7684a84e9f0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.228414 Aug 24 05:00:19.297113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 81/169] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:19.303851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.304901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.311857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.312354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.312781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.313833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.314600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.316165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.317188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.328089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.341515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.345317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9a4324c5-a0e9-4b73-be1f-071f548b085c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.252747 Aug 24 05:00:19.356814 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 89/170] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:19.476076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.483703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cfa27ffc-c890-4825-b98c-b90eaea72a3e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.185425 Aug 24 05:00:19.484309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 82/171] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:19.929360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.930181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.936702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.942009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.942009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.942009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.942009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.942463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.949176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.949826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.956510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.957248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.957930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.959010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.959719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.960331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.165361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.170450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.174954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ffd56810-fa70-4106-b181-04fbf903d985 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.249393 Aug 24 05:00:20.179549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 90/172] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:20.183015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fd372b1c-af65-472d-8c39-303841cef450 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.239861 Aug 24 05:00:20.183606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 83/173] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:20.320113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:20.347929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:20.347929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.347929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.347929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.348275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.348275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.348275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.368802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:20.369535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:20.375546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.376029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.376462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.377309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.378056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.378485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.510180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.520017 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d215ace-52ee-4cbd-b929-fa43349de08e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.203681 Aug 24 05:00:20.520937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 91/174] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:20 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:20.526159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:20.526904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:20.534886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.535509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.536072 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.536894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.537427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.537909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.550575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.559120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.560621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.569997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-449f2dc9-ef51-43f7-a1d2-19f5640377ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.204980 Aug 24 05:00:20.571001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 84/175] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:20 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:20.670207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.679041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e2751da2-99df-412e-9eb7-ccfafdc3b63a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.156776 Aug 24 05:00:20.679670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 92/176] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:20 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:21.201202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.201815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.203742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.204353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.208025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.208517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.208952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.209645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.210103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.210530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.210639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.211092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.211537 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.212312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.212770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.213197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.414706 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.423045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-da603af4-3789-42e4-982b-26c106e2e171 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.223030 Aug 24 05:00:21.425108 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 93/177] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:21.432521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.442592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b5084ee1-6299-4276-916b-cc3cd4247464 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.245645 Aug 24 05:00:21.443495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 85/178] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:21.542299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.542903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.549509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.550004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.550434 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.551149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.551610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.552040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.594536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.601860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.602106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.602634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.603099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.603995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.604451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.604872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.746407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.755159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-33b9cb5e-956a-482f-a0bb-d34629d69476 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.216606 Aug 24 05:00:21.755748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 94/179] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:21.760219 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.760825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.766798 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.767828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.768868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.769585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.770046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.770479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.785332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.794352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.795914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.797311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7908bda8-5f29-420e-81b3-76d010fc496d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.206363 Aug 24 05:00:21.799076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 86/180] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:21.913010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.920824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e851abd6-c298-488f-ba6a-cc722b2bc6c5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.164137 Aug 24 05:00:21.921411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 95/181] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:22.444948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.445687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.451661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.452147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.452584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.453276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.453737 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.454166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.463224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.463832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.469828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.470319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.470810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.471659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.472134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.472565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.665759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:22.668159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:22.671681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d885a60b-13f0-4d01-814b-214e80f6721f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.230674 Aug 24 05:00:22.673452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 87/182] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:22.677354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1105ec56-e343-4a5f-94d6-557509e7c7ee tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.218023 Aug 24 05:00:22.677997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 96/183] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:22.776789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.777407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.783644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.793350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.793350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.793350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.793350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.793687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.821081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.821598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.827932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.833381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.833381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.833381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.833381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.833940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.972002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:22.979671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-74d52e9f-ce88-424d-b695-8f607f7c7cf2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.206968 Aug 24 05:00:22.980258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 88/184] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:22.984681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.985283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.992813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.993133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.993566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.994266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.994722 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.995175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.000141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.008406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.010924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.011098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-af71ec93-09e1-4173-9098-4888c9392a7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.193905 Aug 24 05:00:23.011628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 97/185] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:23.123571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.131651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-14c1c8fa-6cc5-4457-814a-749a1338db65 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.150445 Aug 24 05:00:23.132226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 89/186] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:23.699306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:23.703565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:23.703691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:23.703691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:23.710949 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.711491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.713392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.716780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.717268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.718164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.718633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.719285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.719911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.720858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.721386 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.721858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.731593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:23.959211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.962367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.966795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6c96a8f8-2a51-4d39-9399-4d99384039ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.271388 Aug 24 05:00:23.967400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 90/187] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:23 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:23.970811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c85973f9-f7f4-4400-836b-7c5c5daf3e4a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.280248 Aug 24 05:00:23.971491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 98/188] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:23 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:23.999954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.000562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.007521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.008005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.008444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.009128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.009581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.010110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.035976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.037101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.046889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.049214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.052563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.053328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.054060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.054493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.208026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.216706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-447d6fc5-50bf-423b-b279-3f6ec363d158 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.220528 Aug 24 05:00:24.217287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 91/189] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:23 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:24.222099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.222708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.228672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.229167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.229817 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.230676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.231221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.231648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.242607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.252767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.253609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.254708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9f44efc6-3042-4cb8-8d8f-d8aecbdd7e41 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.224768 Aug 24 05:00:24.255476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 99/190] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:24 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:24.366593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.374404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c6678762-f3c0-45dd-b27b-e1ccac744de8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.155857 Aug 24 05:00:24.374976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 92/191] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:24 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:24.987887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.988427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.990925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.991576 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.995284 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.995773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.996213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.996910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.997368 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.997521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.998010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.998138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.998441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.999156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.999606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.000025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.195315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.203085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-07730b04-5bf8-4dd8-97f3-93265135cc01 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.219354 Aug 24 05:00:25.206158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 100/192] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:24 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:25.223578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.231236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a9a658d4-919b-4c39-9690-1ad3a30e0545 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.244100 Aug 24 05:00:25.231906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 93/193] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:24 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:25.236742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:25.237363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:25.243652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.244596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.245037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.245740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.246199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.246816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.278522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:25.279165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:25.285538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.286032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.286469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.287201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.287663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.288087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.438527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.447447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5298b80f-24b9-4693-817d-4f6927f13dd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.214414 Aug 24 05:00:25.448321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 101/194] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:25 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:25.452919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:25.453675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:25.460594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.461088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.461529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.461980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.462252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.462735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.463197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.471268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.472741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.474298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f22143c-460b-47da-b2af-b1a16d1dc054 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.200301 Aug 24 05:00:25.475148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 94/195] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:25 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:25.600677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.608713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f4a79d08-d800-4390-b8cc-1530db5de777 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.159392 Aug 24 05:00:25.611548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 102/196] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:25 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:26.226002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.226627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.233571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.234058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.234494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.235221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.235678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.236103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.251834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.253076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.260822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.261323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.261764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.262784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.263441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.263875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.456683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.460250 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.464716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b5bc0517-696d-4f20-a207-79b3f3840a3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.243431 Aug 24 05:00:26.477686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 95/197] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:26.477835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-af6c0cb3-d539-4e49-971f-a3e828d9c70a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.220821 Aug 24 05:00:26.477835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 103/198] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:26.477995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.477995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.477995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.477995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.478251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.478471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.479047 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.480086 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.497015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.497620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.504146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.505270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.505711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.506409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.506863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.507311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.869682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.875106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.878665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-96ed663f-0340-4946-92e2-82013a44165c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.411753 Aug 24 05:00:26.879446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:26.893207 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 96/199] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:26.897689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.899278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.899813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.900779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.902135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8db6037d-694a-46bf-b312-0a58baff2322 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.409001 Aug 24 05:00:26.906356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.906847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.907520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.908401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.909186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.909991 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.919551 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 104/200] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:27.055376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:27.064074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-899dc5ed-abe5-4d1a-9e05-382a0d84e566 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.168724 Aug 24 05:00:27.066194 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 97/201] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:27.168897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4225d1-b115-4951-a361-2118e0bf3022", "name": "network-vif-plugged", "status": "completed", "tag": "8a56cc43-f19d-4e76-ba1f-7968609999dd"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:27.182061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.182860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.183327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.196534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] Creating event network-vif-plugged:8a56cc43-f19d-4e76-ba1f-7968609999dd for instance 6f4225d1-b115-4951-a361-2118e0bf3022 on hv-cinder-85426 Aug 24 05:00:27.201909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-dd450dc5-f8a4-4a11-a850-b4592254961e req-f45adf21-50e1-407a-9ad8-57601d22387a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038512 Aug 24 05:00:27.202515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 105/202] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:27.488240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.488842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.491039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.491739 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.494849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.495568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.496000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.496696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.497151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.497570 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.498238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.498733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.499218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.499908 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.500395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.500818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.695527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:27.699857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:27.704360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fc88e49c-bce1-4005-8ae9-2765f2b4aedc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.220462 Aug 24 05:00:27.705285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 98/203] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:27.709824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b982f538-13be-451d-89e2-8808b23e876f tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.223694 Aug 24 05:00:27.711367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 106/204] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:27.900403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.901051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.907153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.907697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.908262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.909965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.910455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.910894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.930359 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.930963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.937399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.938393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.939177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.940242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.940865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.941319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.112940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.116728 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.121438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d4a54eb5-ebab-4dd6-83a3-38155890fdb4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.224823 Aug 24 05:00:28.122007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 99/205] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:28.124977 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.126491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.126618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:28.127214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:28.127626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0c852801-5522-4da2-ae77-5781da5f55b5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.201431 Aug 24 05:00:28.128164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 107/206] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:28.133229 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.133712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.134226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.134890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.135425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.135853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.270863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.278562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c425426b-a985-4a07-9e01-4da5417d96d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.155429 Aug 24 05:00:28.279150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 100/207] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:28 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:28.725152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:28.725942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:28.731218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:28.732043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.732159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:28.732544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.732986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.733694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.734155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.734630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.738705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.744632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.744632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.744632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.744632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.744976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.938413 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.943375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.949147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-186a4d77-1923-4332-b8fd-ba2c08837ae8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.227000 Aug 24 05:00:28.949743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 108/208] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:28 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:28.953199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f19270a-dc7f-4c43-bee6-466cda11ef0d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.226070 Aug 24 05:00:28.953773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 101/209] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:28 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:29.148247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.149011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.150337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.151410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.157643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.157803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.158345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.158571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.159249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.159743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.160297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.160966 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.161429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.161996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.162513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.163068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.390893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.399951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.401647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.402846 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6d44dab0-2690-4d70-a883-1d5afa29378e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.256392 Aug 24 05:00:29.403553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 102/210] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:29.408076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.408750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.416009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.416527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.422238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.422238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.422238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.422238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.422575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.427723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-518f5b19-d957-4f99-a0d6-90c9db8c4629 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.286698 Aug 24 05:00:29.428560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 109/211] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:29.557744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.565912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-53f2a034-439c-441e-808c-080b6973b666 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.161355 Aug 24 05:00:29.566752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 103/212] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:29.970141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.970914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.975050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.975686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.977815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.978297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.978764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.979561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.980007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.980433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.982192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.982740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.983552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.984249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.984709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.985309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.181471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.184320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.193363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6188e5be-90f2-430c-9153-798df38936b5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.222949 Aug 24 05:00:30.193752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2a8e991b-be67-42e1-9e4e-8c7b9fadc5b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.227226 Aug 24 05:00:30.195054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 104/213] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:30.195730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 110/214] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:30.426415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:30.427048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:30.433160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.435160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.435160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.435160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.435467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.435717 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.449032 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:30.449638 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:30.455642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.456327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.456951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.457773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.458230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.458659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.638101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.641374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.646700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.648208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.649307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2c2c8a30-3db3-4f85-8689-338b95a023b8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.227500 Aug 24 05:00:30.649407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8b426cc8-6ad4-4e6e-8959-76de03518afb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.204305 Aug 24 05:00:30.649858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 105/215] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:30 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:30.649977 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 111/216] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:30 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:30.654461 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:30.655085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:30.661286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.661795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.662236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.662927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.663567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.663996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.789541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.797004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3d7a6f1e-5409-45c8-9aae-20f5445513aa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.146046 Aug 24 05:00:30.797566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 112/217] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:30 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.216321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.216903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.217320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.217544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.226211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.226339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.226697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.226794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.227292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.227399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.227855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.227951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.228308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.228401 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.228731 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.228824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.427197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.431079 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:31.431815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.435783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0b8a536c-f886-412c-9871-c11f2406771b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.225711 Aug 24 05:00:31.436442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 106/218] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.439621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6702e31f-3001-46aa-b2e0-d1273fefa3c4 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.229550 Aug 24 05:00:31.440771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 113/219] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.672262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.673057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.680227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.680227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.680708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.681753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.682298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.683139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.683696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.684225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.687265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.687895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.688391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.691165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.691165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.691165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.887185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.890009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.895154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-05c0351c-cf30-4d61-9405-4a0d1d135688 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.227649 Aug 24 05:00:31.895739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 107/220] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.898215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.899861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.900967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-15d4c52a-1b2f-42b2-8bdf-1b57999ec5ce tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.232040 Aug 24 05:00:31.901644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.901757 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 114/221] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:31.902395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.909217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.910139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.910669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.911624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.912108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.912532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.037259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:32.044799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7a0220ac-dff4-4652-b302-3210bac05b9b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.147306 Aug 24 05:00:32.045367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 108/222] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:32.457866 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.459209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.463475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.464274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.466922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.471956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.472551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.472963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.473219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.473795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.474358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.474717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.475053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.475213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.475650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.475998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.678378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:32.682991 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:32.686152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-aca42393-d58c-4448-a3d7-0f3672df878f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.232262 Aug 24 05:00:32.686704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 115/223] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:32.691766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c1ea338e-1b32-49fe-8e75-dd6ea6f41bc6 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.233756 Aug 24 05:00:32.692331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 109/224] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:32.917998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.918635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.923264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.925448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.925723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.925963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.926422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.927183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.927647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.928335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.932289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.932781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.933242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.939489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.939489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.939489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.128392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.131405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.136300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0100776e-4964-472f-a61e-6e8b130b1b5d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.222207 Aug 24 05:00:33.151504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 116/225] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:33.151638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.151791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:33.151888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.151986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:33.152082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-51a2df9c-1ffc-49f8-9f63-7c70a1a7da96 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.223693 Aug 24 05:00:33.152082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 110/226] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:33.152247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.152247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.152247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.152247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.152566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.152566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.290378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.298028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-09c068f0-b5e3-49ef-9788-6b2214a936ad tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.160143 Aug 24 05:00:33.298585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 117/227] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:33 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:33.707603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:33.708224 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:33.712685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:33.713926 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:33.714475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.715115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.715556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.716278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.716735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.717181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.719780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.728535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.728535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.728535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.728535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.728884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.922633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.930367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.937862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cdfdb345-d195-4bd4-bf5f-af0eb8a80490 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.234719 Aug 24 05:00:33.954490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 111/228] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:33 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:33.954938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-01037c56-e67c-46ed-8773-e30113bfcf10 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.230136 Aug 24 05:00:33.954938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 118/229] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:33 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:34.160017 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.162386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.167419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.167680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.168043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.168276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.168768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.169521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.170127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.170554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.181410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.181904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.182343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.183060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.183744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.184171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.380809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.386141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.389284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5fcbcc35-799f-4bd3-9542-4f2d6172fe8e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.234688 Aug 24 05:00:34.389907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 112/230] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:34.394390 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafe7c72-03ed-4290-b32a-f2ea4cea4b5b", "name": "network-vif-plugged", "status": "completed", "tag": "7d5c8ebf-0828-4896-8dfd-0ddc4b429c21"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:34.401877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.403906 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.404071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.404455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.404830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.405019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-516bed55-9acb-4fe8-8383-f86574df1337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.241227 Aug 24 05:00:34.405576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 119/231] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:34.412151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.413103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.417992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] Creating event network-vif-plugged:7d5c8ebf-0828-4896-8dfd-0ddc4b429c21 for instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b on hv-cinder-85426 Aug 24 05:00:34.420867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.421458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.422076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.422992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.423618 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.423753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-08c2503e-8a42-4d8e-b60a-cedcf227fe5a req-745bc0ba-f786-4193-931b-1cb4e29e4f93 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032587 Aug 24 05:00:34.424893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 113/232] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:34.425032 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.564585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.583143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6c5db713-b72b-42bb-b586-92161ed2e2dc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.165849 Aug 24 05:00:34.583143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 120/233] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:34.965531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.966470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.966749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.967399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.972931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.973418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.973890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.974244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.974594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.974733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.975076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.975193 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.975600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.975893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.976353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.976779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.169712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.173113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.178175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1c407eb8-f682-4e81-9c40-2b174ee9186a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.214805 Aug 24 05:00:35.178845 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 121/234] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:35.181768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2d4a30db-2e86-4ccc-aa88-3a65d71bc2a5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.220504 Aug 24 05:00:35.182371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 114/235] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:35.410589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:35.411236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:35.417163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.417649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.418094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.418789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.419280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.419715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.424325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:35.433182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:35.434019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:35.440664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.441149 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.441585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.442281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.442734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.443373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.622682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.631400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dfd651d4-3257-41f9-a639-16f8d91b1165 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.224719 Aug 24 05:00:35.631985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 122/236] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:35 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:35.636371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:35.636971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:35.641792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.649119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.649612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.650079 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.650916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.651173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.651796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.652233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.652567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.653709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4f0828af-cbc5-404f-b4ff-da5889d0c698 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.224417 Aug 24 05:00:35.654305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 115/237] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:35 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:35.779648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.788042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-551ded13-b055-4dd9-abd2-4bd1de669e5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.155090 Aug 24 05:00:35.788614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 123/238] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:35 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:36.201062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.209595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.210941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.211176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.247702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.260403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.261555 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.265225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.266261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.267105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.268672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.269602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.275731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.276561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.279988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.281193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.652693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.668214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f8e5f71c-19ec-4815-80ce-173c60290661 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.470366 Aug 24 05:00:36.669943 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 116/239] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:36.671147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.676507 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676b64f6-0ef9-4250-8e40-a7c922046984", "name": "network-vif-plugged", "status": "completed", "tag": "936c85cd-1e05-4281-b3e6-13b1c7718075"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:36.682260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-525b0259-5ae1-4f34-a635-be5f5fd38af5 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.476962 Aug 24 05:00:36.685349 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 124/240] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:36.699519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.700510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.709271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.710117 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.710780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.711995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.712995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.713556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.720668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.721277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.721720 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.744194 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] Creating event network-vif-plugged:936c85cd-1e05-4281-b3e6-13b1c7718075 for instance 676b64f6-0ef9-4250-8e40-a7c922046984 on hv-cinder-85426 Aug 24 05:00:36.751857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-933be23e-f14e-4c49-8cf7-a4e1fa1146d4 req-06b974fa-e5a6-45c7-8244-a6174e479a1d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079605 Aug 24 05:00:36.754087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 117/241] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:36.760897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.761604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.768590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.769086 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.769670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.770382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.771279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.771416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.915347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.923009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7a252ca6-cf0b-4fb0-bbb7-7a0d02ebd88a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.236423 Aug 24 05:00:36.924634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 125/242] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:36.929569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.930196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.936093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.936580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.937254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.938151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.938796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.940307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.962785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.974509 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.980308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.981745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f6b8464-8f6b-4613-be8e-3263fb9b4ee8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.226228 Aug 24 05:00:36.982311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 118/243] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:37.122157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:37.130481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4dc6705d-f8f5-42fc-9f3c-3bc9f19f041d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.204692 Aug 24 05:00:37.131094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 126/244] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:37.692633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:37.693248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:37.699566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.700054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.700489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.701179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.701639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.702062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.703728 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:37.704337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:37.710807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.711321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.711751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.712438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.712889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.713310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.892713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:37.899412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:37.900460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-701396c4-1980-4bc8-aa58-0755aea2f5f7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.212366 Aug 24 05:00:37.901036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 119/245] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:37 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:37.907483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9841621b-62fe-4852-b175-e997c71c8dba tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.207531 Aug 24 05:00:37.908944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 127/246] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:37 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:37.944699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:37.945275 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:37.952546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.953113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.953629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.954334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.954914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.955394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.006228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.007101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.012844 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.013329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.013758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.014449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.014899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.015504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.133435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.141444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-070eba55-d496-41a0-81fe-6b2384ac0473 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.200657 Aug 24 05:00:38.142102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 120/247] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:37 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:38.151047 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.152031 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.158566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.159396 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.159839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.160544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.160997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.161429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.183454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.192337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.193831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.195000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3c5f8305-7717-4f1a-99c7-ba25f09f550f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.192891 Aug 24 05:00:38.195525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 128/248] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:38.292680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.300435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-46dad052-99f3-4a17-b12e-bcc896ee82b0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.152953 Aug 24 05:00:38.301023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 121/249] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:38.922575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.923340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.927971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:38.928983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.930245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.931687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.932363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.932789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.933927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.934380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.934801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.937549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.938106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.938604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.939922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.940525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.940994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.133231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.142623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-299302c0-b5a7-47c2-9310-04875562f452 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.217817 Aug 24 05:00:39.143916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 122/250] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:39.145073 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.153242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6e706421-ebd4-4c4c-b883-a9346d7fcb9f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.235931 Aug 24 05:00:39.153803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 129/251] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:39.162670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:39.163312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:39.169292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.169776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.170219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.170903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.171414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.171841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.217407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:39.218028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:39.225894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.226479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.226919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.227649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.228140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.228577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.534375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.542281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9e5d9f47-69ae-4aad-a9a7-c319844799ea tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.384057 Aug 24 05:00:39.547808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 123/252] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:39 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:39.547808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:39.548046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:39.554385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.554873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.555375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.560375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.560375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.560375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.569470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.577502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.578975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.581376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ad079f85-34a4-4e65-8ef9-bf32a841c229 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.367877 Aug 24 05:00:39.581941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 130/253] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:39 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:39.691097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.694860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:39.699000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ae7984e6-f8cd-4c66-bb96-b8c1287823a5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.155040 Aug 24 05:00:39.699583 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 124/254] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:39 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:40.163675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.164285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.170086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.170699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.171866 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.172521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.173142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.178152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.180340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.188733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.190317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.190789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.192146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.196351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.196764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.383885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.392767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-08ff5e0a-6e50-47c7-9f6e-c138aa8071db tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.232219 Aug 24 05:00:40.396168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 131/255] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:40.421952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.441400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-816bbcd6-01cd-4bab-801d-046c5c6e329a tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.269239 Aug 24 05:00:40.442002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 125/256] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:40.565792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.566412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.572370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.572857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.573299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.573999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.574467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.574899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.607568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.608473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.615692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.616507 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.617143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.618124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.619348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.620322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.799064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.807283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9cd9abee-ef66-4ccb-a82b-0c715b93586e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.246063 Aug 24 05:00:40.808090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 132/257] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:40.819544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.820824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.822734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.827094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.827581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.828013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.829333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.829903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.830686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.831551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.833114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.834219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7edc7766-6c53-4a42-9088-5c7f64a52662 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.231756 Aug 24 05:00:40.834776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 126/258] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:40.960310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.971740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-589efed5-b1f3-4d2c-b7e1-8eb131040c29 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.158842 Aug 24 05:00:40.971740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 133/259] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:41.416918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.417612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.427488 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.427983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.428612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.429476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.429940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.430368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.470253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.471406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.483774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.484367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.484847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.488528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.489025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.489492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.649714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.662427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0acb81ab-f91f-4d42-96e6-49b1293f5d61 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.248347 Aug 24 05:00:41.663110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 127/260] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:41.683812 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.691665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d3424533-7815-4875-a935-57042d45bdc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.227220 Aug 24 05:00:41.692246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 134/261] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:41.829201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.830118 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.836182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.836661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.837116 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.837864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.838323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.838763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.856496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.857401 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.864714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.865310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.865815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.866611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.867156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.867644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.084056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.092051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-28b44220-0f64-439e-83a8-9bc163b6642e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.266638 Aug 24 05:00:42.092811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 128/262] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:42.098687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:42.099337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:42.105373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.105869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.106311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.107034 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.115140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.115140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.134597 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.144389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.145912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.147066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0bb7007c-40ea-43c5-b41b-2b5b23236aa4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.294523 Aug 24 05:00:42.147663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 135/263] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:42.256786 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.264757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7be971b1-6ab0-4643-aef8-a99f7341d1fa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.170715 Aug 24 05:00:42.265337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 129/264] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:42 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:42.292829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "name": "network-vif-plugged", "status": "completed", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:42.302414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.307579 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.307579 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.314411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] Creating event network-vif-plugged:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:00:42.319376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-10af816b-d665-4fab-bd3c-4ad0880c6d94 req-d11fff3c-9e0e-4d5b-a06e-0647b0fcb846 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 Aug 24 05:00:42.319955 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 136/265] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:42.686368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:42.687515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:42.691279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:42.697853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.697853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.697853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.697853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.698192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.698192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.713132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:42.714589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:42.721271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.721872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.723795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.723795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.724165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.724689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.889264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.897557 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ab297a36-e114-49c8-b520-584bf694d2ef tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.214920 Aug 24 05:00:42.898142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 130/266] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:42 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:42.911853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.919473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5aee55ba-b372-4d1b-bf0e-238fbc2809cf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.210948 Aug 24 05:00:42.920057 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 137/267] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:42 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:43.114217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.114828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.121374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.121863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.122306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.123049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.123515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.123942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.170495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.171127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.178995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.179526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.179960 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.180669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.181158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.181581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.363350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:43.371758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5ef38238-1d35-4144-9deb-468f40c973d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.262157 Aug 24 05:00:43.373000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 131/268] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:43.386869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.387946 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.395336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.396062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.396564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.397341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.397947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.398441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.399821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:43.410432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:43.412313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:43.413623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-239aca72-5037-43c3-85d5-75938f659299 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.246940 Aug 24 05:00:43.414227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 138/269] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:43.550080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:43.558839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0fbab727-2432-4012-8511-841afb813f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.184447 Aug 24 05:00:43.563751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 132/270] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:43.917841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.918473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.925395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.929747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.929747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.929747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.929747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.930064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.944566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.945183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.947606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:43.951217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.951707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.952184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.952871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.953327 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.953750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.141883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.146265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.150061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7c25e299-2335-4e57-990c-b0a61e82019a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.236087 Aug 24 05:00:44.150627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 139/271] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:44.153917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7d142bca-d14e-456e-96fc-b5bdba8f74ae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.213243 Aug 24 05:00:44.154482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 133/272] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:44.393376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:44.393987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:44.400108 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.400596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.401036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.401732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.402193 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.402621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.436394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:44.437092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:44.444577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.444987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.445414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.446106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.446716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.447169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.579414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.589345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a90d7df4-815a-4980-ab08-56ccdd0a5db5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.199759 Aug 24 05:00:44.590069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 140/273] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:44 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:44.595470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:44.596084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:44.602214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.602712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.603198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.603883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:44.604344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:44.604776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:44.610603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.621314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.627651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.627651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2bbd55ad-d19f-4253-8501-add30511f17d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.191332 Aug 24 05:00:44.627651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 134/274] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:44 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:44.733070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.741378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a8d36294-5f01-41c5-9b94-cbd2b52564fd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.150094 Aug 24 05:00:44.741950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 141/275] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:44 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:45.170701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.171889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.173583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.174676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.178787 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.179302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.179744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.180446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.180893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.180999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.181322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.181483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.181923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.182640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.183131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.183564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.376519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.380599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.384690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e5464fec-809d-4cd9-a225-f626097cf3af tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.218004 Aug 24 05:00:45.385277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 135/276] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:45.388468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e2a1a629-5232-4492-86cc-b880f4f14580 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.218820 Aug 24 05:00:45.389019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 142/277] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:45.611700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.612308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.618165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.618640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.619094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.619778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.620228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.620648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.658467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.659236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.665371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.665956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.666502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.667300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.667853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.668353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.802822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.811374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-57d6f42e-2cb6-4c7c-ac44-d8310f82e6e8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.204188 Aug 24 05:00:45.825449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 136/278] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:45.825449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.825449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.825449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.825888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.828124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.828892 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.829650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.830094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.833011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.841246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.842747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.843876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-173a565b-72d9-4e43-890e-dd62df2a0deb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.189960 Aug 24 05:00:45.847140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 143/279] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:45.959206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.967267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2433041b-9e60-489e-a56a-bcce20dfcb83 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.154332 Aug 24 05:00:45.967863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 137/280] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:46.406085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:46.406699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:46.410249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:46.410798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:46.413666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.414153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.414585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.415307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.415769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.416194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.416685 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.417174 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.417609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.418306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.418763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.419224 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.611915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:46.615339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:46.619880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4b30967b-791a-4c2d-9d06-17d4060d0b9d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.217699 Aug 24 05:00:46.620458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 144/281] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:46 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:46.623220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-60bf8d93-8083-4d57-bb91-5bdcef5c4b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.217840 Aug 24 05:00:46.623857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 138/282] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:46 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:46.833669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:46.834273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:46.840115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.840599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.841029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.841713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.842165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.842588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.866155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:46.866770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:46.872978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.873881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.874182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.875191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.875671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.876678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.031405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.039254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4ee37185-76e0-4ab3-8e4b-76632f8a5ed1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.209988 Aug 24 05:00:47.039832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 145/283] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:46 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:47.044260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:47.044898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:47.053021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.057192 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.057687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.058147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.058877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.059366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.059802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.061765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.064095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.066638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0049ae98-275f-4f87-b307-79f1b2de2c60 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.204513 Aug 24 05:00:47.067234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 139/284] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:46 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:47.192975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.200625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-20aba6ab-5b91-4e78-8bb3-d836d19c2ecb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.159848 Aug 24 05:00:47.201193 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 146/285] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:47 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:47.640426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:47.641060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:47.644435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:47.645074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:47.647124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.647657 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.648133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.648824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.649276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.649695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.651586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.652124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.652568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.653407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.653898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.654328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.849520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.856563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.864724 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-08c70955-d09c-4831-91df-7197e9fd80be tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1319 microversion: 2.1 time: 0.228103 Aug 24 05:00:47.866475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 140/286] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:47 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:47.877227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-90510002-bf0a-4de4-ad7e-ab90067df2ed tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.236284 Aug 24 05:00:47.877625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 147/287] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:47 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:48.060472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.061086 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.074905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.074905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.074905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.074905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.075479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.075479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.089935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.091152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.094135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:48.098495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.099117 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.099651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.100685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.101213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.101881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.291920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.296248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.302103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cb99a821-a767-4d47-96dd-22ab83bc78fa tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.245129 Aug 24 05:00:48.305795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 141/288] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:48.306994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.307652 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.308251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.308593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.309692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d098e56d-3f9a-44ee-bd1a-b339a249e113 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.223809 Aug 24 05:00:48.310495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 148/289] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:48.314424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.315104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.315702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.316395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.316873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.317325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.451110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.459610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7dc1ad36-8441-40c5-a21c-40f39f642cb3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1326 microversion: 2.1 time: 0.155882 Aug 24 05:00:48.460191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 142/290] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:48.887748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.888389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.894424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.894918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.895400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.896104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.896565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.897001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.897692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.898328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.904487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.905012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.905446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.906177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.906631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.907159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.135833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.142954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.144478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-64a08455-08e0-4099-b561-17b22c3ffb5b tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1505 microversion: 2.1 time: 0.260579 Aug 24 05:00:49.145042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 149/291] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:49.151008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-daeaf911-3328-420b-a10f-30ef0fa65641 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1369 microversion: 2.1 time: 0.257174 Aug 24 05:00:49.151768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 143/292] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1369 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:49.326693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:49.326945 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:49.333279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:49.333821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.351176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:49.352066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.352066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.352066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.352066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.352418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.352490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.352490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.352490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.352490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.352758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.352758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.540686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.544144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.549139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-abcfc405-eed9-4502-bb47-261065ba259d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.227226 Aug 24 05:00:49.549947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 150/293] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:49 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:49.554900 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:49.555541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:49.561700 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.562522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.562646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.562929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.563351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.563994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.564424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.565724 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.567076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c501fea4-d820-46b8-98ae-e8771706e715 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.238668 Aug 24 05:00:49.567933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 144/294] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:49 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:00:49.711272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.722302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f72a0383-fbb3-4251-814a-89b61e3f59db tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1520 microversion: 2.1 time: 0.171157 Aug 24 05:00:49.722863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 151/295] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:49 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:49.743062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:49.745415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:49.751894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.752369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.753433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.754209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.754670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.755124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.823560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'flavor' on Instance uuid 6f4225d1-b115-4951-a361-2118e0bf3022 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:00:50.173482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.180786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.194392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.195420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.196048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.196799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.197272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.197734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.339387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:50.347345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-14ef8b4a-4d4a-402f-aed5-ea1312a07735 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1558 microversion: 2.1 time: 0.177705 Aug 24 05:00:50.347916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 152/296] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:50.369503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.370139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.377962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.378444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.378878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.379604 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.380084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.380502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.507800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c2546db0-65fe-4dad-9d94-a6a75171da79 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022/action" status: 200 len: 32 microversion: 2.1 time: 0.768717 Aug 24 05:00:50.508431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 145/297] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:00:49 2022] POST /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022/action => generated 32 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:00:50.521922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.523325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.528625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7467df02-84bd-4b2e-886f-c1a1b27d5556 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163055 Aug 24 05:00:50.529202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 153/298] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:00:50.533060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.533582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.533985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.534996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.535215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.535895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.570880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.571601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.578239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.584628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.584628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.584628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.584628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.584948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.791770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:50.801016 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5a8891a9-7033-465f-8429-c21f6bc4b6e6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.284452 Aug 24 05:00:50.815184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:50.815987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 146/299] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:50.821629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5e045190-fa8e-4258-a90f-46ea7903ad5a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.255044 Aug 24 05:00:50.821928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.822548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 154/300] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:50.822670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.829595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.830106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.830545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.831301 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.831783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.832234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:51.035381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:51.055720 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:51.059771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:51.066445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0724331f-9c13-4398-a4eb-91cdc2973922 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.248444 Aug 24 05:00:51.088045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 147/301] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:51.822781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:51.823425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:51.830404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:51.830892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:51.831557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.020547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.020547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.020547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.021274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:52.021274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:52.021274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.021274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.022122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.022122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.022122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.022122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.046715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.049727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.058399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4c629073-d70c-4d5a-8c61-c3f88dd98665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1366 microversion: 2.1 time: 0.216850 Aug 24 05:00:52.080122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 148/302] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:51 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:52.080496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-17736242-bdd5-4510-bb4c-8403a0b05589 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.248158 Aug 24 05:00:52.080496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 155/303] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:51 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:52.093245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:52.094640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:52.101251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.101963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.102633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.103526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.104126 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.104697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.295666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e6825c-7456-4e46-8158-e15a11ced942", "tag": "3b8866d6-c018-428f-b34a-771e00bb44a7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:52.316979 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.317998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.318561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.319251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.325718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.327592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.329298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ea32f3fc-a41d-4ea9-8d1c-ae6a67fa3ba3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.239644 Aug 24 05:00:52.332640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] Creating event network-changed:3b8866d6-c018-428f-b34a-771e00bb44a7 for instance 13e6825c-7456-4e46-8158-e15a11ced942 on hv-cinder-85426 Aug 24 05:00:52.342857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 149/304] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:52 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:52.346414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-f2390a81-3061-4c31-938b-30342b41f109 req-300f6d94-982d-4ddc-a585-495c0d302485 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059966 Aug 24 05:00:52.347437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 156/305] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:52.619813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6a3f59-8647-4ca0-8eb0-dd09a7f523d6"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:52.622283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:52.644185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.644719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.645097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.645806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.651165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.652113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.092180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:53.093892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:53.102191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.103479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.104399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.105198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.105847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.106607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.114725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:53.346416 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:53.358160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2598dfa1-95a8-488b-8033-bd499bbbea7d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1553 microversion: 2.1 time: 0.272672 Aug 24 05:00:53.361065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 157/306] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:53 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:53.366585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:53.367819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:53.376357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.377294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.377907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.379218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.379781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.380335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.604265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:53.604265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-91de40fb-a197-49fb-8ea2-e61e7292659b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.241583 Aug 24 05:00:53.604805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 158/307] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:53 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:53.620323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:53.621018 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:53.628332 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.628969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.629633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.630447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.631125 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.631838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.789159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:53.797823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:53.799654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:53.800776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e3c3dd23-0a53-4885-a4d0-0186d3c80751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1411 microversion: 2.20 time: 0.192132 Aug 24 05:00:53.801600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 159/308] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:53 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1411 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:53.819500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:53.820074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:53.826074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.826624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.827089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.827790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:53.828985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:53.829436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:53.924768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d257b1b-2a89-4b32-9035-35da6bad2891 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109237 Aug 24 05:00:53.925355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 160/309] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:00:53 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:54.624432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:54.626491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:54.634437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.635187 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.635797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:54.636696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.637195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.637921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:54.960056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7439ee65-dad5-4962-b406-9d52274161b3 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "POST /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.343890 Aug 24 05:00:54.961705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 150/310] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:00:52 2022] POST /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af/os-volume_attachments => generated 194 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:54.968498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:54.969532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:54.976686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.977306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.977976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:54.978873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.979504 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.980089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.068490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.079109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3b7bc808-767f-486b-9a9d-fd18112962c6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.458287 Aug 24 05:00:55.080319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 161/311] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:54 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:55.300933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.311143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.313462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.314944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c49fdc70-ac62-4dec-907e-c8da53af6874 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1604 microversion: 2.20 time: 0.351892 Aug 24 05:00:55.315707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 151/312] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:00:54 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:00:55.345657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:55.345657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:55.353561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.354283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.355202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.356519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.357235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.358087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.453842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c6fde898-38a8-4cea-90cc-f86a6f8a3d8a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113095 Aug 24 05:00:55.455045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 162/313] 10.222.0.105 () {60 vars in 1321 bytes} [Wed Aug 24 05:00:55 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:00:56.141654 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:56.158057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:56.199749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "676b64f6-0ef9-4250-8e40-a7c922046984", "tag": "936c85cd-1e05-4281-b3e6-13b1c7718075"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:56.211351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:56.212085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:56.214031 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:56.219547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:56.220256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:56.220882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:56.221673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:56.222142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:56.222579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:56.229836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] Creating event network-changed:936c85cd-1e05-4281-b3e6-13b1c7718075 for instance 676b64f6-0ef9-4250-8e40-a7c922046984 on hv-cinder-85426 Aug 24 05:00:56.240266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-5332cf76-b3bd-4d25-bd99-0123597be6a6 req-f23e068f-fdea-4101-bb39-bc4778362fb3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044466 Aug 24 05:00:56.244400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 163/314] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:00:56.460534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:56.484750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d28fdfe6-16fa-492e-8a6d-5b0f6612d04e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.356319 Aug 24 05:00:56.485596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 152/315] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:56 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:57.507500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:57.508198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:57.514958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.515529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.516012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.516851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.517200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.517832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.613662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:57.638543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.639053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.639491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.660832 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] Creating event network-changed:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:00:57.667461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-c9a0c6c4-0de6-47ee-8a4a-e6c1e6cad902 req-c9b74180-4756-4801-9b0c-3ab47b91376f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058467 Aug 24 05:00:57.668954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 153/316] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:00:57.905308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:57.928429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ada57591-aa8e-4d11-8f82-4110edb1cc3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.425342 Aug 24 05:00:57.929752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 164/317] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:57 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:58.955538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:58.956473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:58.964191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.964999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.965329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.966610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.966610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.967042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:59.117954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:59.127616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-95a32e30-4aac-47b9-9027-46a75ddd0f6c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.176259 Aug 24 05:00:59.128222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 154/318] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:00:58 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:00.149311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:00.149909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:00.155855 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:00.157458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:00.157893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:00.158580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:00.159054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:00.159483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:00.293350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:00.301523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5823ea71-ade4-4d48-837d-107f628786c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.156072 Aug 24 05:01:00.302085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 165/319] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:00 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:01.321729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:01.322364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:01.329084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:01.329601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:01.330043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:01.330769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:01.331260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:01.331693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:01.350167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:01.460850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:01.469400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-02624b52-124a-4c54-93ce-044cc8a025bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.150580 Aug 24 05:01:01.469763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 155/320] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:01 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:01.586486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1086284344", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "networks": [{"uuid": "edf3dec8-f9c5-48cd-92fa-61fa29272111"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:01.640055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] validate_networks() for [('edf3dec8-f9c5-48cd-92fa-61fa29272111', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:01:01.992515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:01:01.992943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:01:01.993422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:01:01.993838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:01:01.994255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:01:02.005979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.005979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.005979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.006312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.006685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.007151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.024371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Getting quotas for project 6458afad3a654baebc09ce00a9d695bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:01:02.028395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Getting quotas for user 946a7533230b446f8ff34a0a51d4c2f2 and project 6458afad3a654baebc09ce00a9d695bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:01:02.039361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:01:02.041711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:01:02.236223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b49a93cd-3ec3-4a7a-9c54-320611904a58 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.653347 Aug 24 05:01:02.236868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 166/321] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:01:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:01:02.248114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9027df8c-3abf-445f-9cbb-2f6479d599f4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:02.248720 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9027df8c-3abf-445f-9cbb-2f6479d599f4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:02.304383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9027df8c-3abf-445f-9cbb-2f6479d599f4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:02.311459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9027df8c-3abf-445f-9cbb-2f6479d599f4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1218 microversion: 2.1 time: 0.067529 Aug 24 05:01:02.312035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 156/322] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:02 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:02.490303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:02.490941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:02.497197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.497680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.498141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.498833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.499312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.500354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.638363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:02.646395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8de970e9-5788-43e9-9041-d0e4d428fea2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.159988 Aug 24 05:01:02.646950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 167/323] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:02 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:03.334718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5c29519f-2606-4bfe-bb6e-cf799ed66d66 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:03.335427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5c29519f-2606-4bfe-bb6e-cf799ed66d66 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:03.387680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5c29519f-2606-4bfe-bb6e-cf799ed66d66 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:03.396122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5c29519f-2606-4bfe-bb6e-cf799ed66d66 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1218 microversion: 2.1 time: 0.066579 Aug 24 05:01:03.400185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 157/324] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:03 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:03.668436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:03.669130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:03.676211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:03.676688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:03.677119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:03.677794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:03.678245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:03.678691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:03.810677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:03.819161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f2958937-c111-4e91-86cd-796df769c050 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.154474 Aug 24 05:01:03.819742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 168/325] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:03 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:04.417352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:04.417955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:04.425405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:04.426149 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:04.426586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:04.427296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:04.427751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:04.428172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:04.495302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:04.503875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6b987f75-408c-42b0-881a-584f47669016 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1214 microversion: 2.1 time: 0.090881 Aug 24 05:01:04.504441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 158/326] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:04 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:04.839965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:04.840541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:04.847216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:04.847698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:04.848128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:04.848799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:04.849254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:04.849671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:04.976721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:04.984497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-09e41611-4a2b-4397-88a8-3a8598d360d2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.148277 Aug 24 05:01:04.985055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 169/327] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:04 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:05.524565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:05.525091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:05.531564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:05.532059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:05.532491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:05.534282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:05.534739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:05.535205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:05.595446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:05.603374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-32d9aab4-2218-40b5-b70d-a1a8893377ac tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1214 microversion: 2.1 time: 0.082610 Aug 24 05:01:05.603944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 159/328] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:05 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:06.006415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:06.007036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:06.012891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.013383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.015696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.015696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.015696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.015696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.147493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:06.155002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b73e4f8e-8159-4c9a-93d8-ce62f55988e4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.152951 Aug 24 05:01:06.155575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 170/329] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:06 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:06.624321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:06.624970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:06.631729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.632231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.632671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.633367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.633830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.634284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.695565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:06.703074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-009b57e8-fb2e-4234-89c3-38af7087520a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1214 microversion: 2.1 time: 0.082645 Aug 24 05:01:06.703632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 160/330] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:06 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:07.177174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:07.177779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:07.183780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:07.184266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:07.184704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:07.185397 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:07.185853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:07.186281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:07.314149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:07.322326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-cb683bf0-cf71-48ac-b0d3-d1c359a41ba9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.149520 Aug 24 05:01:07.322887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 171/331] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:07 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:07.724825 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:07.725438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:07.731904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:07.732321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:07.732754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:07.733445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:07.733902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:07.734328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:07.796600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:07.805057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-67018c08-ca7c-45f2-8ec9-a451144e4bfb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1214 microversion: 2.1 time: 0.084689 Aug 24 05:01:07.805614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 161/332] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:07 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:08.343257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:08.343854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:08.347118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:08.350380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:08.350852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:08.351311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:08.351987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:08.352436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:08.352853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:08.482395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:08.490098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b20b47da-9140-4864-81f7-efce096e110c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.150741 Aug 24 05:01:08.490657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 172/333] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:08 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:08.825990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:08.826631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:08.833928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:08.834414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:08.834857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:08.835594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:08.836056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:08.866184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:08.897628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:08.905299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-020b5968-6439-4620-bd43-ab39ca08894f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1270 microversion: 2.1 time: 0.083243 Aug 24 05:01:08.905865 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 162/334] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:08 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:09.352330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:09.352868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:09.359003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.359510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.359944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.360628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.361081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.361646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.391521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:01:09.510889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:09.511477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:09.517478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.521166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.521691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.522463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.523102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.523714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.667797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:09.677747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e9b526b6-fd6c-4ea8-a949-f334ed4e46f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.170620 Aug 24 05:01:09.679083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 163/335] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:09 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:09.804041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9b71611f-2437-4309-a066-1798424e8fa8 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 204 len: 0 microversion: 2.1 time: 0.455530 Aug 24 05:01:09.804857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 173/336] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:01:09 2022] DELETE /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:01:09.812764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:09.813419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:09.819985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.820474 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.820939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.821637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.822117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.822550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.929949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:09.930898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:09.941656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.942244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.942880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.943638 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:09.944143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:09.944557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:09.949240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:10.028923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:10.035387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:10.041052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8e4b13f6-54e1-415c-a085-ea45e72137fe tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1557 microversion: 2.1 time: 0.232008 Aug 24 05:01:10.044433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 164/337] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:09 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:10.047523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-df4f943d-9b19-41db-939b-3daef8b66924 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1288 microversion: 2.1 time: 0.124924 Aug 24 05:01:10.059719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 174/338] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:09 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:10.699491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:10.700222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:10.706144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:10.706644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:10.707108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:10.707810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:10.708381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:10.708721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:10.839070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:10.849052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-968f3aa0-28b9-45f4-b918-065574044a9e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.153629 Aug 24 05:01:10.849625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 165/339] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:10 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:11.062743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:11.063385 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:11.070128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.070576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.070679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:11.071091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:11.071276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:11.071704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.072159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.072590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:11.077245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.077742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.078183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:11.078885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.079377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.079811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:11.265505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:11.273398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:11.274468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-80c4a904-36af-4067-a957-7cb84ed606bb tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1557 microversion: 2.1 time: 0.215519 Aug 24 05:01:11.275062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 175/340] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:11 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:11.281261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c6db9db2-fdfa-418a-934c-301293451963 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1330 microversion: 2.1 time: 0.214450 Aug 24 05:01:11.281808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 166/341] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:11 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1330 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:11.871562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:11.872165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:11.879046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.879521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.879957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:11.880690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:11.881130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:11.881625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.034209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:12.037827 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:12.149012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:12.156968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ebc4eca4-80de-4c19-bb5b-fdab6861b204 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.289535 Aug 24 05:01:12.157648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 176/342] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:11 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:12.297587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:12.298252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:12.302876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:12.303515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:12.306691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:12.307228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:12.307695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.308399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:12.308916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:12.309351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.310529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:12.310648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:12.310997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.311696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:12.312151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:12.312571 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.513755 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:12.521878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:12.523099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1eeb92ed-7681-4d62-a74b-9e78fed5b379 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1557 microversion: 2.1 time: 0.230795 Aug 24 05:01:12.527137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 167/343] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:12 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:12.528165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9cfbce-6de9-46e4-8d87-9f6688954e9b", "tag": "1afe1f7f-b1d0-4460-aaf7-f26caada4122"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:12.535041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-474de6a5-f865-48e4-9bcc-84a5341a21e5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.236543 Aug 24 05:01:12.536485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 177/344] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:12 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:12.539338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:12.540109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:12.540753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:12.553696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] Creating event network-changed:1afe1f7f-b1d0-4460-aaf7-f26caada4122 for instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b on hv-cinder-85426 Aug 24 05:01:12.558785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-e8e6b9ec-f713-453c-9139-ee91c764adb1 req-0f2126d7-b4b2-458d-8c96-23ee1ea29451 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034032 Aug 24 05:01:12.559463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 168/345] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:01:13.178727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:13.179931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:13.185929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.186419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.186838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.187563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.188009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.188729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.331228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:13.339681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2ec52b74-8931-494a-9417-031b7cc5ef9c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.165647 Aug 24 05:01:13.340278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 178/346] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:13 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:13.554408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=4 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:13.558698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:13.559451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:13.559590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:13.560465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:13.564811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=81 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:13.566923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.567157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.567579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.567682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.568026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.568236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.568741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.569127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:13.569228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.569588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:13.569701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.570013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:13.775441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:13.779492 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:13.795750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f122677d-3440-4dc6-832a-d863cea60f1d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.229178 Aug 24 05:01:13.795750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 179/347] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:13 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:13.795990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-03cc4915-677d-491f-befe-4e3ea7c2baed tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1557 microversion: 2.1 time: 0.236430 Aug 24 05:01:13.795990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 169/348] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:13 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:14.361782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:14.362393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:14.368265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.368743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.369177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.369872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.370326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.370762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.503498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:14.511328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ecc55ca0-940d-4b74-a517-13f02c75acb6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.153799 Aug 24 05:01:14.511888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 180/349] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:14 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:14.574664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ffd41-8ca1-4080-bf08-dfb4e18d93af", "name": "network-vif-deleted", "tag": "fd702a10-383b-4b70-aecf-908548494e62"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:14.585731 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.586232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.586668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.597580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] Creating event network-vif-deleted:fd702a10-383b-4b70-aecf-908548494e62 for instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af on hv-cinder-85426 Aug 24 05:01:14.602416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-d5ae10f7-2594-4bfe-a1e5-abc8061462b5 req-b20fdd01-0b94-4ad7-91d5-cd7908a89033 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Aug 24 05:01:14.603036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 170/350] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:01:14.805299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:14.806143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:14.811267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:14.811969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:14.812630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.813368 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.813880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.815315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.815718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.816148 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.818931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.819447 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.821713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.821713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:14.821713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:14.821713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:14.910424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:14.919249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2392647b-69ae-4d71-8be4-0c1e3ff625ea tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1350 microversion: 2.1 time: 0.112120 Aug 24 05:01:14.920059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 171/351] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:14 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:14.975411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:14.983523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ea0c8c73-f8a5-4f8a-95b2-f55ae37fd889 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.181993 Aug 24 05:01:14.984629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 181/352] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:14 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:15.532983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:15.533598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:15.539562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:15.540057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:15.540505 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:15.541209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:15.541670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:15.542104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:15.701340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:15.710116 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bb584f0a-a247-4225-8dd5-15b71ee4a3a9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.180858 Aug 24 05:01:15.717461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 172/353] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:15 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:15.942430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:15.943122 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:15.949528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:15.949958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:15.950630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:15.951485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:15.952039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:15.952564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.015939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:16.025599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-87143686-60a0-46c0-be3c-90e531193499 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1350 microversion: 2.1 time: 0.087809 Aug 24 05:01:16.025827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:16.026163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 182/354] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:15 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:16.039094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:16.039094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:16.039094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:16.039094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.044673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:16.044673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:16.044673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.173819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:16.181765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1e56af69-609b-4dcb-b5ad-0866b3ef844d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.159934 Aug 24 05:01:16.182333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 173/355] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:16 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:16.731070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:16.731683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:16.738319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:16.738824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:16.739276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.739969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:16.740520 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:16.740862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.890079 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:16.900543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dd571b47-2d34-44ba-a8ea-358d3ccb1d7b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.171439 Aug 24 05:01:16.900543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 183/356] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:16 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:17.046227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:17.046849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:17.054592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.055097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.055528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.056212 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.056665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.057083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.125932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:17.136651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fc2c42d7-ea19-4d57-bd77-926f4f271d0a tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1350 microversion: 2.1 time: 0.094128 Aug 24 05:01:17.137552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 174/357] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:17 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:17.425768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:17.425768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:17.425768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.425768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.426920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.426920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.426920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.426920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.427665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:17.427665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c824806b-3f73-4214-ae49-57039db2ef2d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.157747 Aug 24 05:01:17.427665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 184/358] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:17 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:17.921748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:17.922354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:17.929214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.929668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.930070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.930768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:17.931255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:17.935080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:17.950202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:18.066336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:18.072784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fd0f8bd5-5d7e-402f-a48c-cd6a77ae3453 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.155740 Aug 24 05:01:18.073358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 175/359] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:17 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:18.166690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:18.167477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:18.181664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:18.182203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:18.182709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:18.183992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:18.184607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:18.185105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:18.230449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:18.231009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:18.231635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:18.232132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lazy-loading 'fault' on Instance uuid fd0ffd41-8ca1-4080-bf08-dfb4e18d93af {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:01:18.286446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '312b0174466b4b00be19d78bdc01fdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5545057ecc4c02817cd846dc73b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:18.295877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a40d82b1-26bd-4d6a-ab58-1e9acba83bf0 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 200 len: 1355 microversion: 2.1 time: 0.133209 Aug 24 05:01:18.296636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 185/360] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:18 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 1355 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:18.379489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:18.380332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:18.388602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:18.389288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:18.390137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:18.391347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:18.393569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:18.394236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:18.567867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:18.575679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-03fdfa81-b04b-4c7b-9662-53759e8a7010 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.201292 Aug 24 05:01:18.576287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 176/361] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:18 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:19.093641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:19.094476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:19.100865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.101555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.102179 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.103068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.103677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.104503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.272672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:19.280527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-266cde2d-df39-406b-9603-2c6039238c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.190659 Aug 24 05:01:19.281100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 186/362] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:19 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:19.318140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:19.318786 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:19.325542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.326028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.326460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.327182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.327635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.328055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.342890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] HTTP exception thrown: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Request method failure captured: Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af HTTP/1.1 Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA3g5d0Zkp5PXvcePN6DJ85jGCLgP8p4FKZSZ_5IB3p3ZMf5C11meaoA37vM-1xhWBGsZYTujNSmjVmC39Z4hbOYWiTQt9C_VaXiN8Ee_Tdx_4qU3n1MKVScK6yKXgH_9TyWc82iQ-zdJ-V5xlPk_L5pb2NuMYsuIOvuH1wjDS4O_U Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:01:19.348659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ae5545057ecc4c02817cd846dc73b55b", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}] Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 312b0174466b4b00be19d78bdc01fdb4 Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.350161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'fd0ffd41-8ca1-4080-bf08-dfb4e18d93af'} Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:19.351009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.352232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.353222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Returning 404 to user: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:19.353222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0a6a43dd-3c1a-49f8-abad-94bdb73a069d tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 404 len: 111 microversion: 2.1 time: 0.036243 Aug 24 05:01:19.353222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 177/363] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:19 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:19.469758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:19.473113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:19.479327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.479893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.480389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.481329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.481856 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.482351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.495507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] HTTP exception thrown: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Request method failure captured: Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af/os-volume_attachments HTTP/1.1 Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3g5d0Zkp5PXvcePN6DJ85jGCLgP8p4FKZSZ_5IB3p3ZMf5C11meaoA37vM-1xhWBGsZYTujNSmjVmC39Z4hbOYWiTQt9C_VaXiN8Ee_Tdx_4qU3n1MKVScK6yKXgH_9TyWc82iQ-zdJ-V5xlPk_L5pb2NuMYsuIOvuH1wjDS4O_U Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:19.499870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ae5545057ecc4c02817cd846dc73b55b", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}] Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 312b0174466b4b00be19d78bdc01fdb4 Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.501410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'server_id': 'fd0ffd41-8ca1-4080-bf08-dfb4e18d93af'} Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:19.502225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:19.505485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:19.506732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Returning 404 to user: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:19.506732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9ca81a48-2d30-4420-8e16-e6c9e37122e1 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039244 Aug 24 05:01:19.506732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 187/364] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:01:19 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:19.599061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:19.599895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:19.606252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.606827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.607456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.608334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:19.608799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:19.609235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:19.748918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:19.757586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1a0cbcaa-2543-427e-9b1e-38bca5e11fbe tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.162434 Aug 24 05:01:19.758171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 178/365] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:19 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:20.303289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:20.304038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:20.315232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.315232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.315232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.315232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.315807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.315807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.444233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:20.451921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2a3a02e9-0a57-48d1-9b70-de953ee517c0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.154033 Aug 24 05:01:20.452483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 188/366] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:20 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:20.779634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:20.780247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:20.787531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.788021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.788466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.789168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.789634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.790090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.808410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9cfbce-6de9-46e4-8d87-9f6688954e9b", "name": "network-vif-plugged", "status": "completed", "tag": "1afe1f7f-b1d0-4460-aaf7-f26caada4122"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:20.818533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.819199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.819718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.830695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] Creating event network-vif-plugged:1afe1f7f-b1d0-4460-aaf7-f26caada4122 for instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b on hv-cinder-85426 Aug 24 05:01:20.835950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-9ffe5646-4a2b-4aed-b715-164f5d1435e6 req-f0300f14-f975-492f-be93-6adf4003dae5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031623 Aug 24 05:01:20.836572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 189/367] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:01:20.896473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:20.903200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:20.903664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.904156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.904619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.905327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.905786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.906215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.920603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] HTTP exception thrown: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Request method failure captured: Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af HTTP/1.1 Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3g5d0Zkp5PXvcePN6DJ85jGCLgP8p4FKZSZ_5IB3p3ZMf5C11meaoA37vM-1xhWBGsZYTujNSmjVmC39Z4hbOYWiTQt9C_VaXiN8Ee_Tdx_4qU3n1MKVScK6yKXgH_9TyWc82iQ-zdJ-V5xlPk_L5pb2NuMYsuIOvuH1wjDS4O_U Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:20.923421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ae5545057ecc4c02817cd846dc73b55b", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}] Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 312b0174466b4b00be19d78bdc01fdb4 Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.925186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'fd0ffd41-8ca1-4080-bf08-dfb4e18d93af'} Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:20.925989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.927207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.928636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Returning 404 to user: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:20.928636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-995fd0fc-aca6-4200-8d75-dafc50e6ea30 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 404 len: 111 microversion: 2.1 time: 0.034019 Aug 24 05:01:20.928636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 190/368] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:01:20 2022] DELETE /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:20.937834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:20.938440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] [instance: fd0ffd41-8ca1-4080-bf08-dfb4e18d93af] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:20.944989 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:20.946652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.947499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.948480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.949310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:20.950002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:20.950635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:20.953188 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9ba9d04e-8c51-421f-85fe-52fd5c12b422 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.177537 Aug 24 05:01:20.953748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 179/369] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:20 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:20.968328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] HTTP exception thrown: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Request method failure captured: Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af HTTP/1.1 Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3g5d0Zkp5PXvcePN6DJ85jGCLgP8p4FKZSZ_5IB3p3ZMf5C11meaoA37vM-1xhWBGsZYTujNSmjVmC39Z4hbOYWiTQt9C_VaXiN8Ee_Tdx_4qU3n1MKVScK6yKXgH_9TyWc82iQ-zdJ-V5xlPk_L5pb2NuMYsuIOvuH1wjDS4O_U Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:20.970599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ae5545057ecc4c02817cd846dc73b55b", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ae5545057ecc4c02817cd846dc73b55b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ae5545057ecc4c02817cd846dc73b55b"}]}] Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: ae5545057ecc4c02817cd846dc73b55b Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058999238 Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 312b0174466b4b00be19d78bdc01fdb4 Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-DeleteServersTestJSON-1058999238-project Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.972469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'fd0ffd41-8ca1-4080-bf08-dfb4e18d93af'} Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:20.973263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. Aug 24 05:01:20.974549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:20.975768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] Returning 404 to user: Instance fd0ffd41-8ca1-4080-bf08-dfb4e18d93af could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:20.975768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-467031b1-c166-4135-83e0-48404d151669 tempest-DeleteServersTestJSON-1058999238 tempest-DeleteServersTestJSON-1058999238-project] 10.222.0.105 "GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af" status: 404 len: 111 microversion: 2.1 time: 0.042767 Aug 24 05:01:20.978808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 191/370] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:20 2022] GET /compute/v2.1/servers/fd0ffd41-8ca1-4080-bf08-dfb4e18d93af => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:21.473314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:21.473971 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:21.480139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:21.480628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:21.481405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:21.482108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:21.482718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:21.483180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:21.915060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:21.923945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a5e939b5-3beb-47dc-849e-ad816b8440d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.455227 Aug 24 05:01:21.924864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 180/371] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:21 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:21.974217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:21.974824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:21.981251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:21.981818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:21.982257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:21.982992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:21.983506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:21.983937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:22.230837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:22.238853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0842e767-e6ff-4998-996d-01785479418b tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1318 microversion: 2.1 time: 0.269076 Aug 24 05:01:22.239452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 192/372] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:21 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:22.948277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:22.950159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:22.958142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:22.958631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:22.959285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:22.959994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:22.960454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:22.960881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:23.170238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:23.182754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6b740037-3dcf-457f-8929-2d2bdf3198e9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.239232 Aug 24 05:01:23.183350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 181/373] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:22 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:23.260613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:23.261300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:23.268433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:23.268921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:23.269503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:23.270373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:23.270844 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:23.271293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:23.284916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:23.509024 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:23.519464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a434cc1c-2fdb-400f-87aa-2105b1bc8df4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1502 microversion: 2.1 time: 0.263219 Aug 24 05:01:23.520337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 193/374] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:23 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:24.209542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:24.210868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:24.217353 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:24.217916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:24.218438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:24.219241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:24.220515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:24.221355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:24.456645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:24.464508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-def8ce1a-d6cf-4214-96a1-1d1e0067ae4d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.259033 Aug 24 05:01:24.465095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 182/375] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:24 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:24.593829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:24.594339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:24.601508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:24.602029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:24.602462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:24.603340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:24.603797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:24.604498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:24.630599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:01:25.031957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ee82b336-ff70-4d0f-9875-dc718c817b8e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 204 len: 0 microversion: 2.1 time: 0.445621 Aug 24 05:01:25.033745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 194/376] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:01:24 2022] DELETE /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:01:25.046365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:25.047276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:25.054039 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:25.054759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:25.055650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:25.056548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:25.057187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:25.057625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:25.225618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:25.233392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-00cc25c2-7664-4f4a-bd50-7b3cb4272d07 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1508 microversion: 2.1 time: 0.190866 Aug 24 05:01:25.233949 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 183/377] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:25 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:25.489445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:25.490683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:25.506019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:25.515041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:25.515673 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:25.519142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:25.519630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:25.520062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:25.667563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:25.676946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0e0f3f95-1772-42aa-b964-2c539b6e808a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.194772 Aug 24 05:01:25.681849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 195/378] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:25 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:26.255181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:26.255952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:26.262308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:26.262801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:26.263309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:26.264015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:26.264478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:26.264911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:26.417465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:26.426196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5213ae7f-5ad2-4423-9e05-c590767bc105 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1508 microversion: 2.1 time: 0.175486 Aug 24 05:01:26.426778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 184/379] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:26 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:26.699285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:26.699897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:26.706625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:26.707148 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:26.707583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:26.708275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:26.708732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:26.709162 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:26.845899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:26.861249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2dabc40f-ef0a-461c-8649-1e0bb0b60478 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.164679 Aug 24 05:01:26.861388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 196/380] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:26 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:27.454711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:27.454711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:27.463908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:27.464815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:27.465260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:27.466100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:27.466635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:27.467686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:27.716817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9cfbce-6de9-46e4-8d87-9f6688954e9b", "name": "network-vif-deleted", "tag": "1afe1f7f-b1d0-4460-aaf7-f26caada4122"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:27.731633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:27.732402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:27.733928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:27.747820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] Creating event network-vif-deleted:1afe1f7f-b1d0-4460-aaf7-f26caada4122 for instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b on hv-cinder-85426 Aug 24 05:01:27.752993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-8920f05f-86e8-4f63-8833-06743fb21913 req-159cf0c0-58a0-46e5-aab8-b14510378bf7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043409 Aug 24 05:01:27.753820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 197/381] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:01:27.880554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:27.882271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a42dd981-cf05-4354-9237-08acc874620a tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Action: 'create', calling method: .version_select at 0x7fde5e4d4b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1683320213", "metadata": {"Type": "work"}}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:27.891134 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-07eefa1f-29ca-4b47-b323-fbd69a74c01d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1508 microversion: 2.1 time: 0.445619 Aug 24 05:01:27.891820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 185/382] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:27 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a42dd981-cf05-4354-9237-08acc874620a tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 122 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:27.892956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1683320213", "metadata": {"Type": "work"}}} Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:27.894256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1683320213', 'metadata': {'Type': 'work'}}}} Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:27.895044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:01:27.896308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:01:27.897326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:01:27.897326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.897326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a42dd981-cf05-4354-9237-08acc874620a tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:27.897326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a42dd981-cf05-4354-9237-08acc874620a tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138606 Aug 24 05:01:27.899164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 198/383] 10.222.0.105 () {60 vars in 1161 bytes} [Wed Aug 24 05:01:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:01:27.903975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:27.904588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:27.905242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6a0918f-7641-4d60-a6c4-5e4976090986 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Action: 'create', calling method: .version_select at 0x7fde5e6be1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015289797", "metadata": {"Type": "work"}}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6a0918f-7641-4d60-a6c4-5e4976090986 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 120 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:27.908935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015289797", "metadata": {"Type": "work"}}} Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:27.910692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2015289797', 'metadata': {'Type': 'work'}}}} Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi '0' Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:27.912010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:01:27.913436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:01:27.914976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:01:27.914976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.914976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6a0918f-7641-4d60-a6c4-5e4976090986 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:27.914976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d6a0918f-7641-4d60-a6c4-5e4976090986 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009217 Aug 24 05:01:27.914976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 199/384] 10.222.0.105 () {60 vars in 1161 bytes} [Wed Aug 24 05:01:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:01:27.915513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:27.915513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:27.915513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:27.915513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:27.915863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:27.915863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:27.920340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5a0da086-cc26-472e-abe9-857e3e6b2be9 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Action: 'create', calling method: .version_select at 0x7fde5e72e940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1989759607", "metadata": {"Type": "work"}}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5a0da086-cc26-472e-abe9-857e3e6b2be9 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 119 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:27.924610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1989759607", "metadata": {"Type": "work"}}} Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:27.926085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1989759607', 'metadata': {'Type': 'work'}}}} Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi '' Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:27.927451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:01:27.929053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:01:27.930089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:01:27.930089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.930089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5a0da086-cc26-472e-abe9-857e3e6b2be9 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:27.930089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5a0da086-cc26-472e-abe9-857e3e6b2be9 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009220 Aug 24 05:01:27.930089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 200/385] 10.222.0.105 () {60 vars in 1161 bytes} [Wed Aug 24 05:01:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:01:27.936144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b057212e-eb25-4021-8d77-2039dd0569ce tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Calling method '.version_select at 0x7fde5e49dc10>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:27.978484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-b057212e-eb25-4021-8d77-2039dd0569ce tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] HTTP exception thrown: Volume tempest-invalid-380678245 could not be found. Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b057212e-eb25-4021-8d77-2039dd0569ce tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-380678245 HTTP/1.1 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:27.980449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume tempest-invalid-380678245 could not be found. Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'tempest-invalid-380678245'} Aug 24 05:01:27.981697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-380678245 could not be found. (HTTP 404) (Request-ID: req-dfcf2d43-6c06-4d94-a5c6-173956aaf5c7) Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.982463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:01:27.983586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-380678245 could not be found. Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:27.984601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-380678245 could not be found. Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-380678245 could not be found. Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b057212e-eb25-4021-8d77-2039dd0569ce tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 404 to user: Volume tempest-invalid-380678245 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b057212e-eb25-4021-8d77-2039dd0569ce tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/tempest-invalid-380678245" status: 404 len: 98 microversion: 2.1 time: 0.049221 Aug 24 05:01:27.986399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 201/386] 10.222.0.105 () {58 vars in 1220 bytes} [Wed Aug 24 05:01:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-380678245 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 05:01:27.992824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-36d1344b-7a63-459c-8816-fb48a5973c93 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004545 Aug 24 05:01:27.993552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 202/387] 10.222.0.105 () {58 vars in 1145 bytes} [Wed Aug 24 05:01:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 05:01:28.008588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3b3bf0bd-bb87-4374-9e8b-7217e3cb0976 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004954 Aug 24 05:01:28.008588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 203/388] 10.222.0.105 () {58 vars in 1142 bytes} [Wed Aug 24 05:01:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 05:01:28.014847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6cf79109-0d28-4042-9c60-cbd351da4cc4 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Calling method '.version_select at 0x7fde5e4d4f70>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-6cf79109-0d28-4042-9c60-cbd351da4cc4 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] HTTP exception thrown: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6cf79109-0d28-4042-9c60-cbd351da4cc4 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/os-volumes/64c2714e-bb6d-41b3-8d00-3ec696007f85 HTTP/1.1 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:28.070993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '64c2714e-bb6d-41b3-8d00-3ec696007f85'} Aug 24 05:01:28.073022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. (HTTP 404) (Request-ID: req-7fb5bbe2-bfcc-483a-8eaa-aad8e3f8bc90) Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.073876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:01:28.074907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:01:28.077589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6cf79109-0d28-4042-9c60-cbd351da4cc4 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 404 to user: Volume 64c2714e-bb6d-41b3-8d00-3ec696007f85 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6cf79109-0d28-4042-9c60-cbd351da4cc4 tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/64c2714e-bb6d-41b3-8d00-3ec696007f85" status: 404 len: 109 microversion: 2.1 time: 0.059691 Aug 24 05:01:28.079568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 204/389] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:01:28 2022] DELETE /compute/v2.1/os-volumes/64c2714e-bb6d-41b3-8d00-3ec696007f85 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:28.084819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7781c8bc-6699-4c8c-b53d-af4500cb64ac tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Calling method '.version_select at 0x7fde5e75be50>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:28.111151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:28.121972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ed44b5aa-31cd-4914-bc57-c2fca184a474 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.221707 Aug 24 05:01:28.122551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 186/390] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:27 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:28.136140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-7781c8bc-6699-4c8c-b53d-af4500cb64ac tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] HTTP exception thrown: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7781c8bc-6699-4c8c-b53d-af4500cb64ac tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Request method failure captured: Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/os-volumes/532a542f-67ea-44b6-9a2f-544b3e658fc9 HTTP/1.1 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCn-vf0l3yPVH0ucGWMQx1GkujWioze_YAC25t3v1tPEopYKPs6_O1IQOllA8xS-fn5FZfTBGUzAOt6AC34zLRhQPJVQkxiWu78UROj-ufUFR0gMEh5TH5aiz7O4LzAyX85jgnXLOFKccWPKXzLUbxc8PNycrJCN_NdLGQwuXMBxVU Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:28.137833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0f8c9d23baa4412cb6fc1e1749cd5212", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0f8c9d23baa4412cb6fc1e1749cd5212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0f8c9d23baa4412cb6fc1e1749cd5212"}]}] Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 0f8c9d23baa4412cb6fc1e1749cd5212 Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesNegativeTest-348145245 Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 47eff05ff6b64972a00031fd74ebf211 Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesNegativeTest-348145245-project Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '532a542f-67ea-44b6-9a2f-544b3e658fc9'} Aug 24 05:01:28.139131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. (HTTP 404) (Request-ID: req-2373f8f7-ac9e-423b-acd7-5f2780433686) Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.140155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:01:28.141449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:01:28.142488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7781c8bc-6699-4c8c-b53d-af4500cb64ac tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] Returning 404 to user: Volume 532a542f-67ea-44b6-9a2f-544b3e658fc9 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7781c8bc-6699-4c8c-b53d-af4500cb64ac tempest-VolumesNegativeTest-348145245 tempest-VolumesNegativeTest-348145245-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/532a542f-67ea-44b6-9a2f-544b3e658fc9" status: 404 len: 109 microversion: 2.1 time: 0.062371 Aug 24 05:01:28.144440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 205/391] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:01:28 2022] GET /compute/v2.1/os-volumes/532a542f-67ea-44b6-9a2f-544b3e658fc9 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:28.913391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:28.914997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:28.920841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:28.921326 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:28.921944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:28.923631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:28.924750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:28.925493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:28.960581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:28.960581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:28.961023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:28.961497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lazy-loading 'fault' on Instance uuid ec9cfbce-6de9-46e4-8d87-9f6688954e9b {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:01:29.015267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:29.025835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c34316e0-4e33-4fa0-8507-aea5c73f8e89 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 200 len: 1308 microversion: 2.1 time: 0.116471 Aug 24 05:01:29.026356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 187/392] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:28 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:29.149424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:29.150253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:29.157881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:29.158454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:29.158953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:29.159738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:29.160268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:29.160744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:29.349169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:29.357442 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ef6cce22-feb9-417a-aea2-2a82072bdb2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.213638 Aug 24 05:01:29.359880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 206/393] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:29 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:30.048541 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:30.049357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: ec9cfbce-6de9-46e4-8d87-9f6688954e9b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:30.055906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.056392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.056831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.057535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.058028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.058421 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.072344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] HTTP exception thrown: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Request method failure captured: Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b HTTP/1.1 Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbCK1wW12l5_2VVEwu6LE_0NDiTaTnFsC3ak064UPekbxSeydfKI79kGYhpC3pgb01AW7vF7XrMB6R0_dehFETD0C6zc0QJtY9XTnA6aq8Y35IEXy44zl04H12vfjSH1kMtdo6KSB4tGM3urfjLoAeA4s2RdstISh0ifLOv2c9sUc4c Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 6458afad3a654baebc09ce00a9d695bb Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-VolumesActionsTest-853892765 Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:01:30.075560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6458afad3a654baebc09ce00a9d695bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_6458afad3a654baebc09ce00a9d695bb", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/6458afad3a654baebc09ce00a9d695bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6458afad3a654baebc09ce00a9d695bb"}]}] Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-VolumesActionsTest-853892765 Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 6458afad3a654baebc09ce00a9d695bb Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-VolumesActionsTest-853892765 Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-VolumesActionsTest-853892765-project Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 946a7533230b446f8ff34a0a51d4c2f2 Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-VolumesActionsTest-853892765-project Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. Aug 24 05:01:30.077087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'ec9cfbce-6de9-46e4-8d87-9f6688954e9b'} Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:30.078161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. Aug 24 05:01:30.081035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:30.082697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Returning 404 to user: Instance ec9cfbce-6de9-46e4-8d87-9f6688954e9b could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:30.082697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-963ee895-2fbd-4e43-be85-ecc4f164e31e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b" status: 404 len: 111 microversion: 2.1 time: 0.033187 Aug 24 05:01:30.082697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 188/394] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:30 2022] GET /compute/v2.1/servers/ec9cfbce-6de9-46e4-8d87-9f6688954e9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:30.213123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1238103053", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "networks": [{"uuid": "edf3dec8-f9c5-48cd-92fa-61fa29272111"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:30.277184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] validate_networks() for [('edf3dec8-f9c5-48cd-92fa-61fa29272111', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:01:30.380993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:30.381814 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:30.389459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.389958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.390399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.391976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.392646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.393414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.742862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:30.753273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-47ef6e24-0b29-4729-ba69-16e0a4627eaa tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.375297 Aug 24 05:01:30.754730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 189/395] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:30 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:30.871813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:01:30.872486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:01:30.873470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:01:30.874092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:01:30.874567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:01:30.887007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.887633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.888170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.889933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:30.890511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:30.891813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:30.928503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Getting quotas for project 6458afad3a654baebc09ce00a9d695bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:01:30.935275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Getting quotas for user 946a7533230b446f8ff34a0a51d4c2f2 and project 6458afad3a654baebc09ce00a9d695bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:01:30.967111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:01:30.970981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:01:31.097710 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-38894f97-5250-4f3a-86fe-8de765026126 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.888119 Aug 24 05:01:31.098381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 207/396] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:01:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:01:31.112068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c73d3070-bacd-4d0d-b370-b0d3be9e09fb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:31.114469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c73d3070-bacd-4d0d-b370-b0d3be9e09fb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:31.226994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c73d3070-bacd-4d0d-b370-b0d3be9e09fb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:31.240869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c73d3070-bacd-4d0d-b370-b0d3be9e09fb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1218 microversion: 2.1 time: 0.135167 Aug 24 05:01:31.243834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 190/397] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:31 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:31.776994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:31.777621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:31.784652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:31.785399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:31.786027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:31.786740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:31.787236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:31.787698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:31.938610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:31.946575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d60e63da-0e42-4531-a706-550040ee1e10 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1526 microversion: 2.1 time: 0.173475 Aug 24 05:01:31.948163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 208/398] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:31 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:32.268347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:32.268954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:32.277704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:32.278188 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:32.278626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:32.279349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:32.279808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:32.280234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:32.343563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:32.351726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-550a4c6b-ef0e-4854-bc29-933c57e1c55a tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1222 microversion: 2.1 time: 0.087295 Aug 24 05:01:32.352301 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 191/399] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:32 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:32.968288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:32.968849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:32.975184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:32.975671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:32.976111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:32.976803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:32.977292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:32.977717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:33.110917 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:33.118535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-284daa72-aa1b-4cad-955a-1d6ea0225093 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1506 microversion: 2.1 time: 0.154188 Aug 24 05:01:33.119115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 209/400] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:32 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:33.145370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:33.145987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:33.152104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:33.152592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:33.153034 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:33.153731 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:33.154194 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:33.154878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:33.292650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:33.300859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e5de8fbe-9044-456d-8de8-e42452ef68a2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1519 microversion: 2.1 time: 0.159866 Aug 24 05:01:33.301436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 192/401] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:33 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:33.376851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:33.378120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:33.386785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:33.388885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:33.389681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:33.390602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:33.391967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:33.392581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:33.490963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:33.498832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e2cd2ff2-14b9-4423-875a-737cf80eb4ca tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1270 microversion: 2.1 time: 0.129945 Aug 24 05:01:33.499425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 210/402] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:33 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:34.521344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:34.522037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:34.529061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:34.529546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:34.529976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:34.530670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:34.531343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:34.532935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:34.599861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:34.612123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-addbdb68-09ac-4c1d-8fe4-2d4f2d24eacb tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1276 microversion: 2.1 time: 0.094819 Aug 24 05:01:34.614000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 193/403] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:34 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:35.634780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:35.635496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:35.642886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:35.643457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:35.644004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:35.644763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:35.645221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:35.645640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:35.704754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d666789-8be4-4c0d-b8ae-29846269ec6c", "tag": "0b5119e0-6711-499e-88b5-16472ba1c18e"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:35.732784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:35.733281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:35.733721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:35.761838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:35.772008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] Creating event network-changed:0b5119e0-6711-499e-88b5-16472ba1c18e for instance 1d666789-8be4-4c0d-b8ae-29846269ec6c on hv-cinder-85426 Aug 24 05:01:35.777252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-0b17c27b-c5be-49ea-a6d8-42168b60c1e1 req-149f2cdf-48dd-40cb-b955-3bc5464ffa38 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089799 Aug 24 05:01:35.780449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 194/404] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:01:35.849968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:35.857735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0e0a315a-63c9-4b37-ac33-7b4d79c15f03 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.226908 Aug 24 05:01:35.858286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 211/405] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:35 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:36.175595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:36.180548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:36.187319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.188213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.188915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:36.190094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.190435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.191044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:36.215692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'flavor' on Instance uuid dafe7c72-03ed-4290-b32a-f2ea4cea4b5b {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:01:36.521581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-80413b1b-33fe-41d6-bdd5-c9fd1894641f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/action" status: 200 len: 32 microversion: 2.1 time: 0.351440 Aug 24 05:01:36.522164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 195/406] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:01:36 2022] POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:01:36.532077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:36.532811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:36.539123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.539685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.540128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:36.540828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.541288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.541719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:36.676746 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:36.684692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-07cc6763-f621-420a-9f0e-6267ed0eea49 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.156781 Aug 24 05:01:36.685198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 212/407] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:36 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:36.879929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:36.880631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:36.886809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.887370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.888123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:36.888826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:36.889289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:36.889716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:37.027685 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:37.041893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fb432bc6-b88f-4213-850b-43f3c17555f5 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.161939 Aug 24 05:01:37.041893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 196/408] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:36 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:37.706881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:37.707630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:37.713688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:37.714163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:37.714602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:37.715322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:37.715924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:37.716496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:37.881764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:37.900424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9433cd0f-f6f3-41c2-9bff-38ab7f990473 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.198479 Aug 24 05:01:37.902678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 213/409] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:37 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:38.064637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:38.065257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:38.071882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:38.072376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:38.072821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:38.073665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:38.074204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:38.074705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:38.218408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:38.227137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-23b43305-f185-4998-b687-43a97795aa30 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.167013 Aug 24 05:01:38.227739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 197/410] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:38 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:38.928736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:38.929362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:38.936159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:38.936644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:38.937215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:38.938009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:38.938470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:38.938896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:39.094334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:39.102293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-80f5cb86-eaf5-45d6-8907-331ec886a096 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.181619 Aug 24 05:01:39.102861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 214/411] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:38 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:39.254792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:39.256214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:39.262868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:39.263711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:39.264236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:39.265030 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:39.266585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:39.267262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:39.415479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:39.426358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7f0cefa1-1389-456f-b970-247ca26138e7 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.177783 Aug 24 05:01:39.426964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 198/412] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:39 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:40.125158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:40.126173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:40.132904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:40.134648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:40.135315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:40.135838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:40.136699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:40.137402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:40.138089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:40.284400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:40.293238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6e3d3d5d-141f-435a-ab88-16b80ab39427 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.173090 Aug 24 05:01:40.294140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 215/413] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:40 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:40.449652 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:40.451455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:40.458704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:40.459356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:40.459785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:40.460482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:40.460938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:40.461395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:40.651007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:40.657889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6c5817a6-b844-4659-afb5-866f0cbb9335 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.212842 Aug 24 05:01:40.660643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 199/414] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:40 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:41.044358 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-314978030", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:41.053277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:41.054156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:41.105998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] validate_networks() for None {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:01:41.317535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:41.318360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:41.321552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:41.337649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.338373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.338994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.339899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.340520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.341106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.476999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:01:41.477505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:01:41.477944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:01:41.478297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:01:41.478703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:01:41.496181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.497260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.497698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.498593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.499253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.501070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.523632 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Getting quotas for project 4f3f7cf061114254b3a440f64b16d803. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:01:41.527139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:41.528471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Getting quotas for user ebea1b500dd44a9888d5cd18c55b0909 and project 4f3f7cf061114254b3a440f64b16d803. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:01:41.539482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4a6526a0-2180-472d-9cb0-49a025b96a9d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.226725 Aug 24 05:01:41.540083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 200/415] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:41 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:41.548010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:01:41.550609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:01:41.667916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e6af1658-7b6c-4ee7-b5c7-904a10f2fea7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.627309 Aug 24 05:01:41.668562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 216/416] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:01:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:01:41.687585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:41.688394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1c4208d9-4763-4b28-9f1e-31e3c4cc88cc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:41.688613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:41.692009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1c4208d9-4763-4b28-9f1e-31e3c4cc88cc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:41.707585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.707585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.707585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.707585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:41.708071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:41.708071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:41.747606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1c4208d9-4763-4b28-9f1e-31e3c4cc88cc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:41.755867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1c4208d9-4763-4b28-9f1e-31e3c4cc88cc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1218 microversion: 2.1 time: 0.077835 Aug 24 05:01:41.756640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 217/417] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:41 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:41.880172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:41.881285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-11afcad0-04a4-41a5-bb75-972a077a029e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.203236 Aug 24 05:01:41.881863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 201/418] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:41 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:42.561745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:42.563038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:42.569109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:42.569589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:42.570025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:42.570913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:42.571401 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:42.571829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:42.717574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:42.733161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d3b9ad9d-bd44-4433-ab4e-dbe878063d74 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.170509 Aug 24 05:01:42.733161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 218/419] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:42 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:42.778705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c5906df7-e612-4246-8eef-0201956821aa tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:42.779558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c5906df7-e612-4246-8eef-0201956821aa tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:42.839886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d666789-8be4-4c0d-b8ae-29846269ec6c", "name": "network-vif-plugged", "status": "completed", "tag": "0b5119e0-6711-499e-88b5-16472ba1c18e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:42.849821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c5906df7-e612-4246-8eef-0201956821aa tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:42.853683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:42.857374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:42.857925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:42.861588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c5906df7-e612-4246-8eef-0201956821aa tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1218 microversion: 2.1 time: 0.088262 Aug 24 05:01:42.862203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 202/420] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:42 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:42.863156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:42.870968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] Creating event network-vif-plugged:0b5119e0-6711-499e-88b5-16472ba1c18e for instance 1d666789-8be4-4c0d-b8ae-29846269ec6c on hv-cinder-85426 Aug 24 05:01:42.877114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-ede33d73-d357-4435-98de-fb41e4f19706 req-47340ef6-2113-4d29-ba84-416fde6b5873 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042180 Aug 24 05:01:42.877702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 219/421] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:01:42.902829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:42.903483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:42.910389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:42.910873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:42.911331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:42.912023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:42.912482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:42.912906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:43.072471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:43.081210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e1f01cd9-376f-49da-a1f5-fe98cd1a902d tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.182506 Aug 24 05:01:43.081777 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 203/422] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:42 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:43.754316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:43.757617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:43.773154 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:43.773865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:43.774370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:43.775377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:43.776018 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:43.776769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:43.883060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:43.883793 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:43.891495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:43.891985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:43.892609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:43.893326 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:43.893784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:43.894212 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:43.927362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:43.934937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9ceb261e-c672-48c4-8643-7765cff15e5b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.185968 Aug 24 05:01:43.935534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 220/423] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:43 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:43.959465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:43.967073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-77774a26-36ca-4cb9-99c2-01dac18707a6 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1270 microversion: 2.1 time: 0.087942 Aug 24 05:01:43.967636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 204/424] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:43 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:44.102303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:44.102925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:44.109160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.109669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:44.114985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:44.114985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.114985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:44.114985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:44.243055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:44.251280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-48cc3d82-2905-4d76-8227-89cd904dd2aa tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.153474 Aug 24 05:01:44.251847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 221/425] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:44 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:44.956534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:44.957111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:44.959414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=78 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:44.964256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.964594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:44.965308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:44.965841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.966285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:44.966950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:44.989231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:44.990158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:44.996763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.997250 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:44.997684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:44.998397 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:44.998902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:45.000090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:45.096655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:45.107522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-586d8750-c4b1-4331-8ac2-198058546492 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1270 microversion: 2.1 time: 0.122241 Aug 24 05:01:45.111055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 222/426] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:44 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:45.182609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:45.191821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b90453d1-2905-4843-bc1a-e73103a4aba0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.239248 Aug 24 05:01:45.192449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 205/427] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:44 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:45.272354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:45.273314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:45.280217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:45.281264 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:45.281911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:45.282581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:45.283063 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:45.283498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:45.438270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:45.446917 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-02a3f6d1-56fd-42b1-b296-88869b44053f tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1503 microversion: 2.1 time: 0.178386 Aug 24 05:01:45.447544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 223/428] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:45 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:46.146980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:46.147661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:46.160942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.162809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.162809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.163159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.163818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.164254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.217394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:46.218513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:46.226511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.227224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.227843 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.228732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.229345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.229928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.242099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:46.250621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-88b5db32-efcf-4e03-a469-c6faee9615e0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1276 microversion: 2.1 time: 0.121700 Aug 24 05:01:46.255047 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 206/429] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:46 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:46.364669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:46.372869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5003c426-8b6a-4ae5-a7cf-3435809836f2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.159390 Aug 24 05:01:46.375948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 224/430] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:46 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:46.536820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:46.537317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:46.544032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.544689 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.545298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.546140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:46.547131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:46.547769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:46.574406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:01:47.054035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-799f4466-71fd-4fc2-8939-16bd9d7f1a9e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 204 len: 0 microversion: 2.1 time: 0.520789 Aug 24 05:01:47.054628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 207/431] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:01:46 2022] DELETE /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:01:47.063795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:47.064409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:47.070222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.070709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.071184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.071878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.072351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.072813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.237109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:47.245654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-eeb1272c-7299-4b34-a140-8859d7eb9911 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1509 microversion: 2.1 time: 0.186493 Aug 24 05:01:47.246235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 225/432] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:47 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:47.272881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:47.273649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:47.280366 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.280959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.281468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.282231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.290313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.290313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.398167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:47.398786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:47.406247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.407350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.407958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.408867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.409604 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.410202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.429588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:47.433356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:47.439199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-83f5eb21-b902-45d3-b744-2d9fe411db90 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.170544 Aug 24 05:01:47.451052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 208/433] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:47 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:47.570452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:47.579453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5f0bc46d-3fa8-404f-9405-16f01f7d0b25 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.185137 Aug 24 05:01:47.591200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 226/434] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:47 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:47.853535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a802b07-79fa-4c8e-bbd4-ca36e53ef659", "tag": "38f4df75-483d-4a10-9d8a-6cb74e13c335"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:47.863402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:47.863874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:47.864477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:47.876173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] Creating event network-changed:38f4df75-483d-4a10-9d8a-6cb74e13c335 for instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 on hv-cinder-85426 Aug 24 05:01:47.880962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-b5379984-20cf-4aa9-b66e-39b3a3c8165b req-cec2247d-8154-4e25-aab3-446c7751ed36 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031046 Aug 24 05:01:47.881880 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 209/435] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:01:48.266857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:48.267503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:48.273897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.274406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.274834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.275575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.276213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.276642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.419417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:48.429132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-73aec384-1700-487c-95b8-23a1918252b1 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1509 microversion: 2.1 time: 0.166035 Aug 24 05:01:48.429705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 227/436] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:48 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:48.461714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:48.462609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:48.469454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.474344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.474344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.474344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.474344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.474650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.601346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:48.601956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:48.605884 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:48.608001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.608436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.608977 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.609680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:48.610132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:48.610554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:48.614342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f454418c-8fef-426f-b697-409db02b5b73 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.157760 Aug 24 05:01:48.614923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 210/437] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:48 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:48.755950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:48.764785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-90243b93-4aed-414d-95a4-e066b702b393 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.167238 Aug 24 05:01:48.766423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 228/438] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:48 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:49.450254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:49.450846 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:49.459003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.459671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.460442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.460811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.461266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.461687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.631286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:49.637104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:49.637715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:49.641103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4b92e078-c088-4116-b476-ebc676095bef tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1509 microversion: 2.1 time: 0.194641 Aug 24 05:01:49.641678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 211/439] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:49 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:49.650540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.651106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.651569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.652300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.652766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.653231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.786642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:49.787268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:49.793378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.793872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.794345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.795102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.795565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.796025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.854730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:49.863287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b7c3666e-3029-40d7-98ed-0e342dc8e414 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.230010 Aug 24 05:01:49.864003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 229/440] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:49 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:49.897161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d666789-8be4-4c0d-b8ae-29846269ec6c", "name": "network-vif-deleted", "tag": "0b5119e0-6711-499e-88b5-16472ba1c18e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:49.912606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:49.913090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:49.913521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:49.925875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] Creating event network-vif-deleted:0b5119e0-6711-499e-88b5-16472ba1c18e for instance 1d666789-8be4-4c0d-b8ae-29846269ec6c on hv-cinder-85426 Aug 24 05:01:49.931069 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-24bfa3ca-aa8a-4ebe-acfa-e147c4151614 req-818a6bfc-0455-40aa-a29c-26cdedf8ad6d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037469 Aug 24 05:01:49.931669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 230/441] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:01:49.975147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:49.982815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e1f1c0ed-edbf-490c-bf93-c557d34b5bfd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.200181 Aug 24 05:01:49.983495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 212/442] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:49 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:50.665489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:50.666235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:50.672735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.673510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.674010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:50.674717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.675213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.675644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:50.740488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:50.748473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-19630ca5-dc3a-4fbf-98c7-19fa75b9e06c tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1467 microversion: 2.1 time: 0.087175 Aug 24 05:01:50.749692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 231/443] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:50 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:50.886557 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:50.887140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:50.898477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.898477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.898477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:50.898477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:50.898759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:50.898759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.005298 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:51.006392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:51.012792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.013286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.013718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.014711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.015390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.016001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.027986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:51.035736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f6971b51-a36b-450c-b5b0-10e141a01236 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.153003 Aug 24 05:01:51.036309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 213/444] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:50 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:51.151132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:51.158949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-968cd61e-44b3-4f36-b40d-5c08c33cdda7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.157665 Aug 24 05:01:51.159534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 232/445] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:50 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:51.769851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:51.770451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:51.776457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.782798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.782798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.782798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:51.782798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:51.783524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:51.844928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:51.853530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-200054e8-c51f-4e8c-9947-f8faf15991cc tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1467 microversion: 2.1 time: 0.087389 Aug 24 05:01:51.854237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 214/446] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:51 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:52.057467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:52.058102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:52.060053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:52.060736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=8 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:52.066439 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.066964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.067494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.068268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.068717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.069136 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.180542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:52.183465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:52.192918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.194090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.199646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.199646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.199646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.199646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.224207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:52.233221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-edc8fec8-4013-43da-8b41-b2849e8550fb tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.179535 Aug 24 05:01:52.247199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 233/447] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:52 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:52.334689 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:52.347458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a4c6e4c0-d8e8-4806-b05d-634979cd852f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.171217 Aug 24 05:01:52.348773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 215/448] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:52 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:52.875135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:52.875748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:52.881778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.882259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.882693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.883412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:52.883871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:52.884290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:52.965867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:52.974221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d7896da1-ec0e-46f1-95a1-f4cad41fcdf4 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1303 microversion: 2.1 time: 0.103700 Aug 24 05:01:52.974799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 234/449] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:52 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:53.254500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:53.255134 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:53.257084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:53.261887 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.262360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.262785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:53.263495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.263935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.264350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:53.369042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:53.369645 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:53.377817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.378354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.378728 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:53.379449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:53.379912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:53.380315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:53.400871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:53.410125 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3e13788c-e4fd-47b6-ae43-f693d163d37b tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.159655 Aug 24 05:01:53.410705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 216/450] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:53 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:53.525889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:53.534526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-38b20ade-7ca5-4895-b923-a6284d952b61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.169344 Aug 24 05:01:53.535105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 235/451] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:53 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:53.996025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:53.996634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:54.002622 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.003131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.003569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.004256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.004709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.005132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.036145 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.036617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.037046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.037487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lazy-loading 'fault' on Instance uuid 1d666789-8be4-4c0d-b8ae-29846269ec6c {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:01:54.077884 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a7533230b446f8ff34a0a51d4c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6458afad3a654baebc09ce00a9d695bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:54.085424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c6497714-10bf-4db4-adb3-d48e1931db0e tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 200 len: 1308 microversion: 2.1 time: 0.093464 Aug 24 05:01:54.085988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 217/452] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:53 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:54.431798 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:54.432585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:54.438681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.439213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.439657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.440344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.440801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.441252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.555204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:54.556602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:54.564216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.565044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.565719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.566657 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:54.567399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:54.568084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:54.576820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:54.585124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-23d5efb2-0af4-4454-a4c1-96f2fbe758d9 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.157102 Aug 24 05:01:54.585699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 236/453] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:54 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:54.720806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:54.729320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-58060449-ca40-4987-83e0-4a67dc444774 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.178054 Aug 24 05:01:54.729902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 218/454] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:54 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:55.106917 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:55.107559 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] [instance: 1d666789-8be4-4c0d-b8ae-29846269ec6c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:55.114100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.114596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.115048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.115759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.116215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.116663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.121168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:55.132656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] HTTP exception thrown: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Request method failure captured: Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c HTTP/1.1 Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbCK1wW12l5_2VVEwu6LE_0NDiTaTnFsC3ak064UPekbxSeydfKI79kGYhpC3pgb01AW7vF7XrMB6R0_dehFETD0C6zc0QJtY9XTnA6aq8Y35IEXy44zl04H12vfjSH1kMtdo6KSB4tGM3urfjLoAeA4s2RdstISh0ifLOv2c9sUc4c Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 6458afad3a654baebc09ce00a9d695bb Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesActionsTest-853892765 Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:01:55.138101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6458afad3a654baebc09ce00a9d695bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_6458afad3a654baebc09ce00a9d695bb", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/6458afad3a654baebc09ce00a9d695bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6458afad3a654baebc09ce00a9d695bb"}]}] Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesActionsTest-853892765 Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 6458afad3a654baebc09ce00a9d695bb Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesActionsTest-853892765 Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesActionsTest-853892765-project Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 946a7533230b446f8ff34a0a51d4c2f2 Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesActionsTest-853892765-project Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. Aug 24 05:01:55.139709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '1d666789-8be4-4c0d-b8ae-29846269ec6c'} Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:55.141438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. Aug 24 05:01:55.142777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:01:55.143882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] Returning 404 to user: Instance 1d666789-8be4-4c0d-b8ae-29846269ec6c could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:55.143882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b0b25778-44a0-4a7c-871c-92ed51de5ef0 tempest-VolumesActionsTest-853892765 tempest-VolumesActionsTest-853892765-project] 10.222.0.105 "GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c" status: 404 len: 111 microversion: 2.1 time: 0.032741 Aug 24 05:01:55.143882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 237/455] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:55 2022] GET /compute/v2.1/servers/1d666789-8be4-4c0d-b8ae-29846269ec6c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:01:55.605726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:55.606360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:55.613698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.614111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.614597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.615312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.615772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.616192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.750899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:55.752267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:55.753945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:55.758666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.759332 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.759772 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.760475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:55.760936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:55.761406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:55.762032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-01c4f491-323e-491d-99de-220b5658afa7 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.160138 Aug 24 05:01:55.762600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 219/456] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:55 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:55.897040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:55.907411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d4ea448a-612f-437e-87cd-660734028b3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.160225 Aug 24 05:01:55.908283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 238/457] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:55 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:56.783465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:56.784090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:56.790441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.791152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.791608 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.792296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.792751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.793167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.899923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a802b07-79fa-4c8e-bbd4-ca36e53ef659", "name": "network-vif-plugged", "status": "completed", "tag": "38f4df75-483d-4a10-9d8a-6cb74e13c335"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:56.910130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.910688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.911214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.923658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] Creating event network-vif-plugged:38f4df75-483d-4a10-9d8a-6cb74e13c335 for instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 on hv-cinder-85426 Aug 24 05:01:56.928851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-a6a89abd-3e75-4144-a6f1-2c0d784a4d80 req-cefe7c82-4e79-4a9b-8fac-098824ca7b3c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032749 Aug 24 05:01:56.929504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 239/458] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:01:56.934337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:56.938985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:56.939722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:56.943049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ed539e5b-471a-4f39-b3bf-f5f8c20bcfe0 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.163855 Aug 24 05:01:56.945539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 220/459] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:56 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:56.946237 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.946727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.947191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:56.947974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:56.948432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:56.948864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:57.087672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:57.095444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-756fb90b-633e-4b00-9389-d0c731eeead9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.164819 Aug 24 05:01:57.096008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 240/460] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:56 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:57.965028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:57.965677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:57.972594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:57.973080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:57.973521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:57.974218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:57.974706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:57.975166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.101159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:58.108850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9dc88e2c-0404-428d-a82f-2ba1add00da8 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.147865 Aug 24 05:01:58.109593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 221/461] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:57 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:58.116142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:58.116748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:58.122702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.123218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.123649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.124859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.125471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.125892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.259603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:58.268940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c3f8eeea-aad3-4115-929c-d81f72a615ee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1505 microversion: 2.1 time: 0.156613 Aug 24 05:01:58.269492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 241/462] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:58 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:58.288742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3176ee7-1d87-4bd4-9003-ff73f90fbd2e"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:58.291158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:58.297091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.297821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.298258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.298954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.299436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.299857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.322860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] HTTP exception thrown: Cannot 'attach_volume' instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b while it is in vm_state rescued Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Request method failure captured: Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/os-volume_attachments HTTP/1.1 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 74 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA5Htayi90YnrUY5eDvk84JHSPLCTE5EUlNB37aFog2OL3bdEZEFXViqEjAiKOreHiy2ek8rGVruVBR2sYLdxqMj2DFFQJEEdcRiKCSa6Etgcks_a_V-xJt7wVc3qafy9gAU66L0J0s8qdP2iUvmTjAXMS48Sk7aZ_OdyNtvdPx2Bc Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:01:58.324795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f2fd5d378aba473ab58753aecb74a065", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}] Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 51926dd0d6934aed907806a5cb14dc2f Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {"volumeAttachment": {"volumeId": "c3176ee7-1d87-4bd4-9003-ff73f90fbd2e"}} Aug 24 05:01:58.326257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Cannot 'attach_volume' instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b while it is in vm_state rescued Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'server_id': 'dafe7c72-03ed-4290-b32a-f2ea4cea4b5b', 'body': {'volumeAttachment': {'volumeId': 'c3176ee7-1d87-4bd4-9003-ff73f90fbd2e'}}} Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:01:58.327575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b while it is in vm_state rescued Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:01:58.329465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b while it is in vm_state rescued Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Returning 409 to user: Cannot 'attach_volume' instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b while it is in vm_state rescued {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-95c44179-6200-449b-bb45-9db0c9574b0d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041396 Aug 24 05:01:58.330536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 222/463] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:01:58 2022] POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:01:58.336182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:58.336717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:58.342630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.343209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.343730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.344616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.345076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.345500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.616283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-53b665e4-21f6-415c-913f-483662e8f607 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/action" status: 202 len: 0 microversion: 2.1 time: 0.283839 Aug 24 05:01:58.616919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 242/464] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:01:58 2022] POST /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:01:58.625437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:58.626061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:58.632093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.632582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.633021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.633740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:58.634203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:58.634632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:58.765026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:58.775736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-49dafc4a-245e-485f-9d01-bb7cbaeebe9a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.152192 Aug 24 05:01:58.775736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 223/465] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:58 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:59.129660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:59.130342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:59.136499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.136985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.137421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.138114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.138573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.139001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.271489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:59.279130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-180926aa-9f3d-4147-9b18-b4562c848d4a tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.153850 Aug 24 05:01:59.279690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 243/466] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:59 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:59.795084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:59.795701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:59.802460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.802945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.803432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.804127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.804584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.805015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.934617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:59.942982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f4fd7be-7e8f-40a7-87e2-9312668fa15d tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.151824 Aug 24 05:01:59.943577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 224/467] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:01:59 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:00.301153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:00.301787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:00.307748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.308227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.308660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:00.309343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.309801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.310223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:00.433445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:00.440995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1753a535-496d-4781-acb5-bb6a288ce73f tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.144569 Aug 24 05:02:00.441558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 244/468] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:00 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:00.963769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:00.964375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:00.971881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.972357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.972790 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:00.973472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:00.973918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:00.974341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.103670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:01.111861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3b932be5-0afc-4dba-bc4d-7392bb7e85ed tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.151859 Aug 24 05:02:01.112416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 225/469] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:00 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:01.461215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:01.461761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:01.467742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.469066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.469495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.470297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.470755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.471215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.604646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:01.613298 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac278c0d-f372-40f9-a227-3753cab6a489 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.155438 Aug 24 05:02:01.613476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 245/470] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:01 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:02.133612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:02.134199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:02.141715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.142195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.143486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.143486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.143819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.144242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.148246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:02.277640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:02.285985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b60a0ac1-9bc0-4fda-912d-341cace57f8f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.156223 Aug 24 05:02:02.286546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 226/471] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:02 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:02.633683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:02.634300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:02.641297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.648062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.648062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.648062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.648062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.648432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.979300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:02.988238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b186dfd0-23bf-4381-aefa-d3e1c76f93d1 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.357840 Aug 24 05:02:02.988369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 246/472] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:02 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:03.308074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:03.308734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:03.316395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.316922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.317398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:03.318144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.318632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.319147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:03.454630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:03.464824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2c2334a7-8331-474d-807b-1f942776be28 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.160850 Aug 24 05:02:03.466529 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 227/473] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:03 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:04.015711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:04.016393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:04.024780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.025891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.025891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.026400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.027099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.027524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.214689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:04.224143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e806355f-ce84-4275-9dbf-e98d0cb0a393 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1318 microversion: 2.1 time: 0.218128 Aug 24 05:02:04.229248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 247/474] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:04 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:04.489825 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:04.491328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:04.500142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.501093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.501485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.502123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.502777 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.503447 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.711976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:04.721113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b197ba83-8117-43ce-b313-6c6b7399a174 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.235264 Aug 24 05:02:04.721737 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 228/475] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:04 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:05.250249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.251218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.258225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.259139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.259987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.260985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.261716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.262356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.436057 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:05.447657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f3dadbaf-87ae-4d7d-912d-93b3b4668523 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1467 microversion: 2.1 time: 0.202220 Aug 24 05:02:05.452789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 248/476] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:05 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1467 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:05.501855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.503187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.511240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.511985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.512638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.513546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.514221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.514894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.548061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:02:05.759531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.760527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.761857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-edcc448e-ac35-459e-832f-d502f533d5e4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 204 len: 0 microversion: 2.1 time: 0.264541 Aug 24 05:02:05.767595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 229/477] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:02:05 2022] DELETE /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:02:05.774964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.777379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.782722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.786817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.789801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.792579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.793148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.793591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.793991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.795494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.796915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.798441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.799251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.802090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:06.027193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:06.041244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a251fb24-304d-4dcc-bb3b-910ae173d4ba tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1473 microversion: 2.1 time: 0.265927 Aug 24 05:02:06.042088 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 230/478] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:05 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:06.080128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:06.090389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a46a79dd-bfa5-4388-95b1-cb1742e0e186 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.348344 Aug 24 05:02:06.091421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 249/479] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:05 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:07.071895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:07.073963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:07.082595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.083221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.083729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.084677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.085352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.086019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.112302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:07.112898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:07.128590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.129088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.131408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.132813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.133324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.133919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.422983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:07.437760 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a7bfb1b1-6cf8-4be8-aad2-465ea8e4d6dc tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1473 microversion: 2.1 time: 0.371912 Aug 24 05:02:07.451077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 231/480] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:07 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1473 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:07.466644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:07.475709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ec962b8c-13c0-48b7-934b-18b2bff37f3c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1513 microversion: 2.1 time: 0.367442 Aug 24 05:02:07.489272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 250/481] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:07 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:08.465993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:08.466630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:08.485518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.486384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.486985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.493602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.493602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.493602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.497677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:08.498462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:08.512846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.514383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.516057 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.517441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.518130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.519165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.762019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:08.771793 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a07dd137-5e1f-4efb-a989-8a66aaafb377 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1473 microversion: 2.1 time: 0.309765 Aug 24 05:02:08.786253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 232/482] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:08 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:08.828152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:08.840521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-299bccf3-385f-45b8-88e6-51eba406e64e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1519 microversion: 2.1 time: 0.347893 Aug 24 05:02:08.860821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 251/483] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:08 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1519 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:09.795422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:09.796813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:09.805213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.805936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.806630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.807593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.808586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.809269 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.992453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:10.002363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d7015641-4605-4d18-9930-3e8073b431c4 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1473 microversion: 2.1 time: 0.211771 Aug 24 05:02:10.002950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 233/484] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:09 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:10.457731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a802b07-79fa-4c8e-bbd4-ca36e53ef659", "name": "network-vif-deleted", "tag": "38f4df75-483d-4a10-9d8a-6cb74e13c335"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:10.468627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:10.471335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:10.471335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:10.481239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] Creating event network-vif-deleted:38f4df75-483d-4a10-9d8a-6cb74e13c335 for instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 on hv-cinder-85426 Aug 24 05:02:10.487566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-434676ae-7574-46d8-8f37-10d46879a5ba req-121a0053-5c94-47d6-b122-e1b8e9019f21 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Aug 24 05:02:10.488517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 252/485] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:11.025035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:11.025639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:11.036820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.040911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.040911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.040911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.040911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.041296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.109885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.110469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.111888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.113109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lazy-loading 'fault' on Instance uuid 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:02:11.185877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebea1b500dd44a9888d5cd18c55b0909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f7cf061114254b3a440f64b16d803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:11.205168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-56dc76a2-c1b7-4762-a561-4a31e9214652 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 200 len: 1308 microversion: 2.1 time: 0.184387 Aug 24 05:02:11.207900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 234/486] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:11 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:11.638143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d439be60-c55d-4438-9bdf-fac6a812d2f6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: .version_select at 0x7fde5e4f6670>, body: {"keypair": {"name": "tempest-keypair-1874707577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcT49Jd7vJoGi8kKMQihB52p+IumhwG9YUsolvbawkBwpOit1EeSF9ERa/EyQ7zkZ4nrDl1LANQODRJkk916IY09nqbSM/HSoVyNsa7bweTjk9g0vnxvERUzpICzfquBg=="}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:11.647682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:11.659678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d439be60-c55d-4438-9bdf-fac6a812d2f6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for project f2fd5d378aba473ab58753aecb74a065. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:02:11.664504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d439be60-c55d-4438-9bdf-fac6a812d2f6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for user 51926dd0d6934aed907806a5cb14dc2f and project f2fd5d378aba473ab58753aecb74a065. Resources: {'key_pairs'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:02:11.751832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d439be60-c55d-4438-9bdf-fac6a812d2f6 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118337 Aug 24 05:02:11.752438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 253/487] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:02:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:12.230154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:12.232008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] [instance: 7a802b07-79fa-4c8e-bbd4-ca36e53ef659] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:12.238319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:12.238987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:12.239421 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:12.240138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:12.240618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:12.241038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:12.255980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] HTTP exception thrown: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Request method failure captured: Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 HTTP/1.1 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbCywu9TjJf2K7sbJ1MI1FAxuDbYqRqalUA3C6XRo4TpyyftQcAQbA3PAQx-uQHFGhuSNoZRRkkzLGKp7Xq7MqRhECCKzLyvLLDxj0RJPxWE9YkRrZLyree14IhEYwkctYdfHZkn19c-YkIXN5w8Lf8IUYaBkx7-PjMzmQk8USjOb1A Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 4f3f7cf061114254b3a440f64b16d803 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-VolumesNegativeTest-384801467 Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:02:12.257682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4f3f7cf061114254b3a440f64b16d803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4f3f7cf061114254b3a440f64b16d803", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4f3f7cf061114254b3a440f64b16d803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4f3f7cf061114254b3a440f64b16d803"}]}] Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-VolumesNegativeTest-384801467 Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 4f3f7cf061114254b3a440f64b16d803 Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-VolumesNegativeTest-384801467 Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-VolumesNegativeTest-384801467-project Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: ebea1b500dd44a9888d5cd18c55b0909 Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-VolumesNegativeTest-384801467-project Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. Aug 24 05:02:12.259280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '7a802b07-79fa-4c8e-bbd4-ca36e53ef659'} Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:02:12.260213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. Aug 24 05:02:12.261543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:02:12.264057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] Returning 404 to user: Instance 7a802b07-79fa-4c8e-bbd4-ca36e53ef659 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:02:12.265549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-acb28c35-1719-4a5f-be13-1a4912b4e180 tempest-VolumesNegativeTest-384801467 tempest-VolumesNegativeTest-384801467-project] 10.222.0.105 "GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659" status: 404 len: 111 microversion: 2.1 time: 0.039736 Aug 24 05:02:12.269823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 235/488] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:12 2022] GET /compute/v2.1/servers/7a802b07-79fa-4c8e-bbd4-ca36e53ef659 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:02:14.567139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-530570036", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45b5889b-1fed-4157-a576-0b6107ddbe4e"}], "security_groups": [{"name": "tempest-securitygroup--813344858"}], "key_name": "tempest-keypair-1874707577", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:15.602534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] validate_networks() for [('45b5889b-1fed-4157-a576-0b6107ddbe4e', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:02:16.146468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:02:16.147792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:02:16.148299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:02:16.148729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:02:16.149509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:02:16.162961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:16.164211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:16.164822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:16.165986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:16.166676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:16.167200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:16.216784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:02:16.222579 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Getting quotas for user 51926dd0d6934aed907806a5cb14dc2f and project f2fd5d378aba473ab58753aecb74a065. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:02:16.237727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:02:16.240729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:02:16.355518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-49979882-a99b-4e54-a222-b324844ebb36 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.795373 Aug 24 05:02:16.356388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 254/489] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:02:14 2022] POST /compute/v2.1/servers => generated 410 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:02:16.370629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4c31e10d-94b7-43ba-b9ac-14216f5bafb7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:16.371517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4c31e10d-94b7-43ba-b9ac-14216f5bafb7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:16.375262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:16.500396 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c31e10d-94b7-43ba-b9ac-14216f5bafb7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:16.512239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4c31e10d-94b7-43ba-b9ac-14216f5bafb7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1249 microversion: 2.1 time: 0.145777 Aug 24 05:02:16.513494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 236/490] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:16 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1249 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:17.538875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d2f8aee1-b4cf-4f7c-8513-40d5e256bd09 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:17.539521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d2f8aee1-b4cf-4f7c-8513-40d5e256bd09 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:17.700247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d2f8aee1-b4cf-4f7c-8513-40d5e256bd09 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:17.723242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d2f8aee1-b4cf-4f7c-8513-40d5e256bd09 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1249 microversion: 2.1 time: 0.191398 Aug 24 05:02:17.738066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 255/491] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:17 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1249 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:18.751517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:18.752965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:18.761624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:18.762432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:18.763112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:18.764410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:18.765311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:18.765979 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:18.845285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:18.868050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dbd8eaeb-e371-4423-a65a-e1ce2508ce4c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1301 microversion: 2.1 time: 0.122294 Aug 24 05:02:18.868050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 237/492] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:18 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:19.891422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:19.892035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:19.898232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:19.898861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:19.899330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:19.900018 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:19.900468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:19.900927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:20.056713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:20.067066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d06e9e2-1450-4cf3-abcf-bdecd594eb94 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.179457 Aug 24 05:02:20.069055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 256/493] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:19 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:21.102472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:21.104577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:21.108637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:21.141372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:21.143118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:21.143852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:21.151052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:21.151665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:21.152127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:21.157149 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:21.157654 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:21.161870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] Creating event network-changed:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:02:21.162483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:21.174166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-1f93bff4-3c8a-414e-bafb-e83d8d4ae29e req-d59bcb6b-2e16-47ac-9d2d-baf50918dffe service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077954 Aug 24 05:02:21.176009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 257/494] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:21.530165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:21.539359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-19e1d40d-f962-467a-9c0a-2909321e8c4f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.449641 Aug 24 05:02:21.540132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 238/495] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:21 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:21.871698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-849893307", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "networks": [{"uuid": "5b9c021b-a4bf-45b4-a6f8-0bf0c3f53161"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:21.986847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] validate_networks() for [('5b9c021b-a4bf-45b4-a6f8-0bf0c3f53161', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:02:22.562738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:22.566901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:22.574928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:22.576877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:22.577616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:22.578501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:22.580318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:22.580930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:22.592863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:02:22.593449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:02:22.593760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:02:22.594166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:02:22.594774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:02:22.619129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:22.619875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:22.620499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:22.621384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:22.621994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:22.622585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:22.636355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:22.656278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Getting quotas for project 2dd4d1addbd348c0a9608c7b3fe27157. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:02:22.664203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Getting quotas for user 3cc9d727a1e044a397b8b8b9883d5dcb and project 2dd4d1addbd348c0a9608c7b3fe27157. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:02:22.685299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:02:22.691595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:02:22.790354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:22.801429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d60ec07d-c558-4921-8ce6-9ed82bdab0b1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.244123 Aug 24 05:02:22.802686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 239/496] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:22 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:22.923873 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e7612a78-dbf4-4ef3-a710-2d9fbaee2622 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.057629 Aug 24 05:02:22.931047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 258/497] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:02:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:02:22.937539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-679decc1-577c-4932-8121-b29e12609471 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:22.938283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-679decc1-577c-4932-8121-b29e12609471 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:23.031601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-679decc1-577c-4932-8121-b29e12609471 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:23.039857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-679decc1-577c-4932-8121-b29e12609471 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1222 microversion: 2.1 time: 0.106917 Aug 24 05:02:23.040769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 240/498] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:22 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:23.823255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:23.824003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:23.831577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:23.832135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:23.832573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:23.839592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:23.839592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:23.839592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:23.973396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:23.978589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-455983f7-647c-4b6f-a475-40de0712c80a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.159546 Aug 24 05:02:23.979279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 259/499] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:23 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:24.062260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0044ac7a-750a-43a4-8509-da0cba775325 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:24.062965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0044ac7a-750a-43a4-8509-da0cba775325 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:24.119104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0044ac7a-750a-43a4-8509-da0cba775325 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:24.127386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0044ac7a-750a-43a4-8509-da0cba775325 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1222 microversion: 2.1 time: 0.069671 Aug 24 05:02:24.127953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 241/500] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:24 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:24.999892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:25.001102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:25.007436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:25.007826 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:25.008263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:25.008942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:25.009389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:25.009810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:25.142681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:25.147735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:25.148374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:25.150270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ae5bcb13-ed65-4cab-9fc2-84305902e6e1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.154267 Aug 24 05:02:25.150838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 260/501] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:24 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:25.154778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:25.156018 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:25.156480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:25.157162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:25.157626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:25.158106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:25.221665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:25.229388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2ca5daea-e32e-40ff-b4ef-698dfdb7580e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1226 microversion: 2.1 time: 0.085528 Aug 24 05:02:25.229925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 242/502] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:25 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:26.170840 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:26.172383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:26.178486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:26.178970 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:26.179436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:26.180134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:26.180740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:26.180992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:26.251570 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:26.253215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:26.259744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:26.260223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:26.261046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:26.261371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:26.261811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:26.262596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:26.343384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:26.345182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:26.352783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a3c80ec1-62b9-4641-8328-a24b7d1353bb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.185517 Aug 24 05:02:26.355243 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 261/503] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:26 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:26.357669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5497da35-32ba-42a5-9857-6ab38c4b584e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1274 microversion: 2.1 time: 0.109540 Aug 24 05:02:26.357791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 243/504] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:26 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:27.386290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:27.386912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:27.387392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:27.387491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:27.393595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:27.393999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:27.394128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:27.394484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:27.394607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:27.394915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:27.395222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:27.395655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:27.395755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:27.396076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:27.396179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:27.403500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:27.416055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:27.712976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:27.721820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-917e95ac-5165-45ef-b291-c5d7085c3b5e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.339299 Aug 24 05:02:27.722522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 244/505] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:27 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:27.770681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:27.779300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f6df96d8-47a7-4fce-8ab9-c0074c6a0675 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.396706 Aug 24 05:02:27.795356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 262/506] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:27 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:28.720094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c457eac0-4570-4491-8e1a-d09cd8fd7d80", "tag": "6582e8f7-2c4c-46ea-842e-2f3abcaf9209"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:28.737749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:28.738065 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:28.739001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:28.743508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:28.744292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:28.751112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:28.751841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:28.752280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:28.752478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] Creating event network-changed:6582e8f7-2c4c-46ea-842e-2f3abcaf9209 for instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 on hv-cinder-85426 Aug 24 05:02:28.753286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:28.753796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:28.754258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:28.757649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-1fcbdab9-996e-4f51-aa4f-25e7ca44cbaf req-b81c3a59-9c97-4840-9d81-b479a3209332 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043244 Aug 24 05:02:28.758430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 245/507] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:28.818189 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:28.819246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:28.839279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:28.841337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:28.841862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:28.850179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:28.854475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:28.854741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:28.912455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:28.932469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9676edb6-f45b-4724-9e2b-14db0779a56a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.193202 Aug 24 05:02:28.938822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 263/508] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:28 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:29.046804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:29.055398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-07c6a35b-f839-476b-85a1-9f06e0994c23 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.250598 Aug 24 05:02:29.056041 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 246/509] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:28 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:29.188319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "name": "network-vif-plugged", "status": "completed", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:29.197789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:29.198449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:29.199124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:29.212035 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] Creating event network-vif-plugged:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:02:29.217085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-6f5f9811-4184-40ee-ba71-f1a01713abc4 req-0dcb9b64-2a2e-4024-b6dd-e1cced9316e5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033902 Aug 24 05:02:29.218454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 264/510] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:29.960970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:29.961673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:29.968185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:29.968672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:29.969161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:29.969886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:29.970347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:29.970771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:30.078167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:30.078886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:30.085170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:30.085661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:30.086099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:30.087147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:30.087300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:30.087819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:30.101618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:30.110907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e0385b24-0491-4e12-8f3a-e0ed15c71c3f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.153934 Aug 24 05:02:30.112265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 247/511] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:29 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:30.228863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:30.238280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4e40bdd4-437d-4c77-9729-31a02b053eab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.164130 Aug 24 05:02:30.238849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 265/512] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:30 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:31.132810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:31.133386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:31.141097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:31.141796 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:31.142228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:31.142923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:31.143398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:31.143853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:31.259643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:31.260272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:31.270709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:31.270709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:31.270709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:31.270709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:31.271222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:31.272282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:31.278252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:31.288254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b45971ff-e42f-4714-98a5-d38ca9b47cc8 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.159491 Aug 24 05:02:31.288833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 248/513] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:31 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:31.410998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:31.418724 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-99421c99-c895-4f39-91f2-d35087307922 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.163056 Aug 24 05:02:31.419442 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 266/514] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:31 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:32.309817 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:32.310928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:32.318275 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:32.318975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:32.319586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:32.320604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:32.321061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:32.322038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:32.444295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:32.445501 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:32.456186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:32.460590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:32.461211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:32.462282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:32.464839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:32.466308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:32.550799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:32.558704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-39599b33-df2b-4d59-ba16-15ca63b87348 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.252654 Aug 24 05:02:32.563690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 249/515] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:32 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:32.637137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=4 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:32.641013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:32.648891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bf5f51ea-3f9e-454e-967d-9af730b669de tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.213139 Aug 24 05:02:32.652052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 267/516] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:32 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:33.580732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:33.581272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:33.587659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:33.588147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:33.588586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:33.589288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:33.589744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:33.590175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:33.674811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:33.675561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:33.678039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=18 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:33.683098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:33.683582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:33.693403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:33.693403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:33.693403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:33.693403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:33.721378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:33.729144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0d7b2133-93f9-48ef-94aa-0975b181d71a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.152999 Aug 24 05:02:33.729716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 250/517] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:33 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:33.821473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:33.829403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-471a96d2-a267-45fc-8801-0ba58f189cf3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.159667 Aug 24 05:02:33.829969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 268/518] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:33 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:34.752921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:34.753530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:34.755502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:34.760686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:34.761172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:34.761613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:34.762303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:34.762763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:34.763292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:34.850056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:34.850701 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:34.856951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:34.857435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:34.857867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:34.858755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:34.859570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:34.860005 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:34.901257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:34.909543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3ba2b6b1-fa7a-47e9-b897-c0c16ee63dd2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1374 microversion: 2.1 time: 0.161318 Aug 24 05:02:34.910705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 251/519] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:34 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:35.004541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:35.012447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-113650ff-f950-4644-a147-8735679896a3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.166262 Aug 24 05:02:35.013712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 269/520] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:34 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:35.933056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:35.933659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:35.940988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.941466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.941897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.945690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.945690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.945690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.035395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:36.036016 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:36.042392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.043007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.043479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.044203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.044662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.045088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.074675 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:36.089469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4e635fbb-16f7-4937-a7e7-ccf21a404688 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1567 microversion: 2.1 time: 0.155625 Aug 24 05:02:36.089469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 252/521] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:35 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:36.104406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:36.104898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:36.128455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.128952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.129387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.130150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.130600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.131056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.248121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-705a0c8c-4010-49d8-823c-562b30d37b0c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147456 Aug 24 05:02:36.249338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 253/522] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:02:36 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:02:36.252489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:36.260908 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7306ba0d-1022-4232-af32-4aeb22d69b3e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.230477 Aug 24 05:02:36.265598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 270/523] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:36 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:37.098908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c457eac0-4570-4491-8e1a-d09cd8fd7d80", "name": "network-vif-plugged", "status": "completed", "tag": "6582e8f7-2c4c-46ea-842e-2f3abcaf9209"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:37.115435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.115915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.116339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.128386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] Creating event network-vif-plugged:6582e8f7-2c4c-46ea-842e-2f3abcaf9209 for instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 on hv-cinder-85426 Aug 24 05:02:37.134785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-7b746a39-cf18-43fd-95ae-0ae00627a8f9 req-6171e8a1-3baf-46fc-91a3-6b8521587634 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Aug 24 05:02:37.135449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 254/524] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:02:37.242722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:37.253084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.254313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.254753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.281940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] Creating event network-changed:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:02:37.281940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-ada52775-3b18-4e8c-a01d-d1b5ffb93445 req-7d0e0292-eb45-4567-b808-401e0ce0ab2c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Aug 24 05:02:37.281940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 271/525] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:37.286002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:37.286706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:37.297987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.298799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.299307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.300031 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.300488 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.300914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.475308 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:37.484410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2f4c8769-b881-439a-aa8f-f1bd6a546640 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.205531 Aug 24 05:02:37.485104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 255/526] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:37 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:38.505430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:38.506149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:38.512717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.513185 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.513624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.514353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.514802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.515247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.646952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:38.654656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-28253014-0f64-4550-89a8-d029a78f6a69 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.153297 Aug 24 05:02:38.655781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 272/527] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:38 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:39.676600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:39.677237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:39.683715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:39.684198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:39.684659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:39.685345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:39.685799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:39.686863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:39.816598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:39.824296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5a45612f-6ef9-41fc-a5ed-00c0bf9bd8a2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.151700 Aug 24 05:02:39.824855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 256/528] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:39 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:40.845647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:40.846259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:40.852355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.852835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.853271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.853965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.854422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.854849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.984153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:40.991759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-19f19b96-8ba0-464c-b294-07706c9761b3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.150482 Aug 24 05:02:40.992305 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 273/529] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:40 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:42.015973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:42.015973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:42.020408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:42.020886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:42.021319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:42.022008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:42.022459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:42.022886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:42.377042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:42.384795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-95f30797-1331-4d8d-8b69-251cfa0be343 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.375270 Aug 24 05:02:42.385361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 257/530] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:42 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:43.405119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:43.405681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:43.412483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:43.412968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:43.413406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:43.414100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:43.414703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:43.415162 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:43.543181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:43.551289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bff0432e-54ae-4515-8de7-6701357b1aa1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1322 microversion: 2.1 time: 0.150113 Aug 24 05:02:43.551869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 274/531] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:43 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:44.572002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:44.572607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:44.579393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:44.579870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:44.580309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:44.581008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:44.581441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:44.581860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:44.725999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:44.735316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-935eddea-c8cd-4a56-b65f-fe1dbebe5294 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1510 microversion: 2.1 time: 0.166861 Aug 24 05:02:44.735809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 258/532] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:02:44 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:51.049196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:51.049744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:51.051894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:51.056585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:51.057065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:51.057502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:51.058188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:51.058642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:51.059094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:51.083752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3842a257-9d18-4e07-a93b-5a087f106b32 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/ips" status: 200 len: 149 microversion: 2.1 time: 0.038760 Aug 24 05:02:51.084324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 275/533] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:02:51 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:54.858223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:54.861401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:54.863858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=51 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:54.864535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=76 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:54.869446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:54.869965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:54.870416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:54.871139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:54.871599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:54.872024 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:55.386871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:55.387476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:55.394716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:55.395271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:55.398184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:55.398184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:55.398184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:55.398184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:55.400116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=93 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:55.423372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a99c8638-102a-4c44-974f-291842c7c0d3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/ips" status: 200 len: 147 microversion: 2.1 time: 0.040417 Aug 24 05:02:55.423957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 276/534] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:02:55 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:55.718217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0bb233b5-25b9-4917-8146-2f24df0c4915 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863905 Aug 24 05:02:55.718934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 259/535] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:02:54 2022] POST /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:56.057019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:56.057589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:02:59.875146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:59.878239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:03:02.058149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d04fda-184e-4aed-a932-c062dfc85e91"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:02.060512 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:02.067869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:02.068340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:02.068769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:02.069449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:02.069899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:02.070314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:03.260799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c7cd34a2-91e7-4bf3-943e-93c119a6e531 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.206366 Aug 24 05:03:03.261473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 277/536] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:03:02 2022] POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments => generated 194 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:04.323282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8a309344-5cbd-446e-a1d4-455e40b19375 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: .version_select at 0x7fde5e676dc0>, body: {"keypair": {"name": "tempest-keypair-2061625610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmrMuMPGwCxGBuMwVhmD3qVBEvB0HN7F1GJocQ4Ulg8/uq9fF79R7uuz7FIdQefEiF/WwTRlcUQV7KS2olmWx2dL+gzzxigeaCjrLaVEPnpPlhzIPzEZqz7+Rj0i0LmMQ=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:04.341623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-8a309344-5cbd-446e-a1d4-455e40b19375 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:03:04.346241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-8a309344-5cbd-446e-a1d4-455e40b19375 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:03:04.429633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8a309344-5cbd-446e-a1d4-455e40b19375 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110549 Aug 24 05:03:04.430236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 260/537] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:06.776408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1597407426", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2d7953-7d09-41eb-b20e-6de03af460a3"}], "security_groups": [{"name": "tempest-securitygroup--12425524"}], "key_name": "tempest-keypair-2061625610", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:06.881820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] validate_networks() for [('be2d7953-7d09-41eb-b20e-6de03af460a3', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:03:07.259227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:03:07.259890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:03:07.260183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:03:07.260593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:03:07.261088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:03:07.272380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:07.274409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:07.274409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:07.274409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:07.274662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:07.275037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:07.292641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:03:07.296918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:03:07.308286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:03:07.310655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:03:07.414226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7ffc9cea-f882-4c39-84ea-3ee36e4caa09 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642972 Aug 24 05:03:07.415037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 278/538] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:03:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:03:07.426758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-15cf96f6-7b6a-4a7f-9f30-41a58c5dc2e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:07.427631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-15cf96f6-7b6a-4a7f-9f30-41a58c5dc2e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:07.430162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:07.493573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-15cf96f6-7b6a-4a7f-9f30-41a58c5dc2e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:07.500837 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-15cf96f6-7b6a-4a7f-9f30-41a58c5dc2e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1246 microversion: 2.1 time: 0.078599 Aug 24 05:03:07.501416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 261/539] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:07 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:08.522830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:08.523469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:08.529698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:08.530177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:08.530705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:08.531422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:08.531879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:08.532303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:08.600064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:08.608666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bc62633b-240e-4660-b7a3-ed0756355ae3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1242 microversion: 2.1 time: 0.090145 Aug 24 05:03:08.615762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 279/540] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:08 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:09.630624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:09.631803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:09.639782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:09.640273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:09.640708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:09.641403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:09.641851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:09.642614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:09.721516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:09.730756 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e2b27ac7-17e4-4094-94dd-fe227ba599ef tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1316 microversion: 2.1 time: 0.104786 Aug 24 05:03:09.743186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 262/541] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:09 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1316 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:10.761133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:10.762006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:10.771325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:10.772287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:10.772792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:10.773642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:10.774404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:10.774898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:10.843160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:10.850976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b6059832-c30e-4f52-b866-be038ddfc1f3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1304 microversion: 2.1 time: 0.093682 Aug 24 05:03:10.851581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 280/542] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:10 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:11.404590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:11.405137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:11.411753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.414299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.414299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.414299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.414299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.414673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.437920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3d68da4f-1ea3-4498-b2b6-d7eb12665e5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/ips" status: 200 len: 152 microversion: 2.20 time: 0.037825 Aug 24 05:03:11.438485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 263/543] 10.222.0.105 () {60 vars in 1294 bytes} [Wed Aug 24 05:03:11 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:03:11.781341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281bea80-9e0d-435a-9fb8-6d5aa8cf3463", "tag": "53368c46-a120-4621-b879-12464bcc2429"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:11.792322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.792803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.793232 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.805783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] Creating event network-changed:53368c46-a120-4621-b879-12464bcc2429 for instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 on hv-cinder-85426 Aug 24 05:03:11.810898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-d2f82d3c-7847-4e05-8b11-0552964fd182 req-4b6ad5b7-ce09-4d3b-885e-493465ecb89d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033272 Aug 24 05:03:11.811802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 281/544] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:11.873545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:11.874158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:11.882472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.883087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.883544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.884542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.884993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.885466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.976785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:11.983740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.984432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.985065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:12.129015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Going to try to stop instance {{(pid=122277) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:03:12.129260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:12.129260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dee84212-e4bf-4490-84c2-8a43c437154d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.191180 Aug 24 05:03:12.129260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 264/545] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:11 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:12.379941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c6a2fc0a-6b85-419d-86f3-735e45fb3c96 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action" status: 202 len: 0 microversion: 2.1 time: 0.407980 Aug 24 05:03:12.382711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 282/546] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:03:11 2022] POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:03:12.390773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:12.391802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:12.398132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:12.404113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:12.404113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:12.404113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:12.404113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:12.404444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:12.541620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:12.550404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-13e3ad0c-27b8-47f9-901d-2eaba70aa53e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.163462 Aug 24 05:03:12.551297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 265/547] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:12 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:13.137992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:13.138704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:13.145748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.146233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.146676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.147415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.147873 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.148297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.282730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:13.290754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-185b31aa-f236-4086-a4d3-ff82b829b29e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.157599 Aug 24 05:03:13.291351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 283/548] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:13 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:13.571591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:13.572322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:13.578615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.579131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.579633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.580391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.580851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.581277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.713314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:13.722066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ad787f41-6670-4020-a013-be6f42cf66f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.154323 Aug 24 05:03:13.722625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 266/549] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:13 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:14.312007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:14.312644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:14.319087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.319573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.320022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.320687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.321139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.321561 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.459462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:14.467235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4f24ad30-bac0-4add-a68c-30e7c5863777 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.158921 Aug 24 05:03:14.467803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 284/550] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:14 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:14.743130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:14.743687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:14.750313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.752607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.752607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.752607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.753113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.753540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.882136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:14.894068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f8daff29-2bf1-419a-aa68-110af6400af3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.154567 Aug 24 05:03:14.894759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 267/551] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:14 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:15.027174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:15.027626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:15.033985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.034364 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.034808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.035421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.035880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.036306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.059271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lazy-loading 'flavor' on Instance uuid ff4d90aa-1f68-4002-962b-207093b0e8dc {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:03:15.488546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:15.489279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:15.495229 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.497394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.497394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.497394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.497394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.497967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.509054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ab2b0b0c-c756-4eb7-8ea7-e109e33a6337 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/action" status: 202 len: 0 microversion: 2.20 time: 0.485611 Aug 24 05:03:15.509957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 285/552] 10.222.0.105 () {62 vars in 1324 bytes} [Wed Aug 24 05:03:15 2022] POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:03:15.518665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:15.520529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:15.525662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.526143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.526575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.527322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.527773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.528478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.699661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:15.707149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:15.707939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fc1a0546-c0d8-4b68-9225-f1a25fd10766 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.224074 Aug 24 05:03:15.708517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 268/553] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:15 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:15.715226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:15.716716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:15.717998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-652c30db-a01e-44a8-b835-454914c6c786 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.203904 Aug 24 05:03:15.718542 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 286/554] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:15 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:15.915212 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:15.915846 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:15.922510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.923060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.923547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.924304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.924819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.925274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.061482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.070138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0a172e4b-f7a1-4464-9594-1b075c8147bc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.159048 Aug 24 05:03:16.070709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 269/555] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:15 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:16.730505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:16.731144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:16.738460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.738942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.739403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.740101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.740555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.740982 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.742603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:16.743242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:16.749150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.749617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.750042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.750723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.751265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.751735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.942776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.945970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.950509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-42a726a3-65fc-4aec-a3f3-d8072a698608 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.223868 Aug 24 05:03:16.951101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 287/556] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:16 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:16.954318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.956177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.957336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3d23155d-6d2d-4902-8909-e63a8f48a619 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.218723 Aug 24 05:03:16.957873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 270/557] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:16 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:17.092316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:17.092930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:17.099361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.103804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.103804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.103804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.103804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.104350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.251122 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:17.259880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4d27e4dd-eac3-4d00-833a-38bc8436e000 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.171299 Aug 24 05:03:17.260474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 288/558] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:17 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:17.972486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:17.973296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:17.975696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:17.980756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:17.981329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.981564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:17.982211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.982655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.983321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:17.983464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.983870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.983988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:17.984294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.991312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.992562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.993146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.993862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.994327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.994758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:18.185780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.188228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.195365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dcb75e4c-eea6-4f77-b4cb-41feb35d7d4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.227904 Aug 24 05:03:18.196018 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 271/559] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:17 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:18.197201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.198707 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.199991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a6623da7-3084-447a-8571-399c8b8e1e74 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.223173 Aug 24 05:03:18.211285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 289/560] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:17 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:18.281476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:18.282096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:18.288091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:18.288571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:18.289004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:18.289691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:18.290148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:18.290568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:18.422430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.431361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-28145ebc-2353-48d7-bd85-80ec7d03932d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.153645 Aug 24 05:03:18.431929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 272/561] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:18 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:19.217411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:19.218055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.224835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.225329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.225815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.226510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.226968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.232956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:19.233401 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.233502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.233593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:19.236289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.237278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.238136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.238866 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.239349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.239833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.433961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:19.441165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:19.443805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-26cf9588-2cc0-43e6-a9ed-394ffb87b5a7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.230175 Aug 24 05:03:19.444624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 290/562] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:19 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:19.449537 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9fe5f13-93f4-41ac-bbd0-83317a85c107", "device": "/dev/sdb"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:19.452839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.454605 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:19.461799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.462502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.462941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.466660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:19.466984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.466984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.467187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ee9798ab-05b3-4e25-83cc-59005c73ead7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.241692 Aug 24 05:03:19.467266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.467340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 273/563] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:19 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:19.470502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:19.471136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.477688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.478179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.478662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.479388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.479843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.480324 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.633679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:19.642026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-de30b105-70e7-42cb-929b-6b9a6761410a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.175697 Aug 24 05:03:19.642577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 274/564] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:19 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:19.647082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281bea80-9e0d-435a-9fb8-6d5aa8cf3463", "name": "network-vif-plugged", "status": "completed", "tag": "53368c46-a120-4621-b879-12464bcc2429"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:19.656224 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.656697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.665972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.668946 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] Creating event network-vif-plugged:53368c46-a120-4621-b879-12464bcc2429 for instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 on hv-cinder-85426 Aug 24 05:03:19.674132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-b40de93d-8395-46d6-8691-2962e9cb4411 req-c395d0f0-fa9c-4d97-a8e9-3c053a8216dc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Aug 24 05:03:19.675662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 275/565] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:20.391637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d827446b-0225-4895-8499-85d40e6e1041 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "POST /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945498 Aug 24 05:03:20.392282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 291/566] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:03:19 2022] POST /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:20.467802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:20.468499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:20.475203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.475685 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.476119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.476803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.477384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.477803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.489421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:20.490115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:20.496390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.499983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.499983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.499983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.499983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.500379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.681574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.688649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.689287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-93228975-e7d9-4b1b-b9f6-a99cfe8bf79d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.226315 Aug 24 05:03:20.690096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 276/567] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:20 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:20.694981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:20.695858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:20.698347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.700202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.701548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a6d99e82-c263-42e5-8a52-b8d5f8678191 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.217282 Aug 24 05:03:20.702017 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.702287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 292/568] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:20 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:20.702712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.703280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.704043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:20.704574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:20.705066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.833928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.841980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ca296ef-a09c-4c72-8c4c-7a30d69923ff tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.150935 Aug 24 05:03:20.842544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 277/569] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:20 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:21.709767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.710293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.716657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.717137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.717571 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.718257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.718711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.719180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.725152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.725781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.732082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.732565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.733001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.733697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.734157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.734585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.920769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:21.924973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:21.929315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2943d221-0a2d-4abd-a2b2-bbba8c09de86 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1370 microversion: 2.1 time: 0.223541 Aug 24 05:03:21.929902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 293/570] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:21 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:21.934117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:21.935916 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:21.937151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-37ad7482-2dda-4413-96ba-bf62daab7769 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.215895 Aug 24 05:03:21.937778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 278/571] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:21 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:21.939204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.940063 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.946395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.946995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.947552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.948349 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.948934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.949604 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.076525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:22.085112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bed82dca-b553-44ce-8cac-507a34238dc2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.154271 Aug 24 05:03:22.085677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 294/572] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:21 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:22.949760 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:22.950393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:22.957136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.957867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.958304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.959042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.959502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.959927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.960422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:22.961101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:22.967692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.968257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.968778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.969543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.970098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.970588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.978561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:23.161322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.164405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.169678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e7382d9e-7e64-42d8-ab43-dcbfb91a586f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1559 microversion: 2.1 time: 0.223732 Aug 24 05:03:23.170864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 279/573] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:22 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:23.173210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.174889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.176173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:23.176782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:23.177046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8dd1a081-2738-4596-9366-4eb7847b9d62 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.221199 Aug 24 05:03:23.178084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 295/574] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:22 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:03:23.194196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.195328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.195748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.196681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.197545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.197633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.200455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:23.201201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:23.208002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.208563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.209189 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.209888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.210345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.210799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.323163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-961cc424-285b-4cc8-b0b4-f4f34b277f82 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126789 Aug 24 05:03:23.323163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 296/575] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:03:23 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:23.376433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.386258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8660bbf3-fff5-4059-bb0c-411b81b69f21 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.214157 Aug 24 05:03:23.395901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 280/576] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:23 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:24.206245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.207513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.213614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.214107 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.214550 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.215265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.215720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.216144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.310355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281bea80-9e0d-435a-9fb8-6d5aa8cf3463", "tag": "53368c46-a120-4621-b879-12464bcc2429"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:24.322117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.322632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.323092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.336159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] Creating event network-changed:53368c46-a120-4621-b879-12464bcc2429 for instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 on hv-cinder-85426 Aug 24 05:03:24.341256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-8acc1649-7249-4216-b192-320581a8bf91 req-f40ed1b0-74f3-43bc-a8fc-2d4ba1aacf00 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034592 Aug 24 05:03:24.341871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 281/577] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:03:24.357372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:24.365831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:24.367488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:24.368737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fec4c27c-813b-46b7-9a40-24fc66b72ce0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.166939 Aug 24 05:03:24.369391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 297/578] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:24 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:24.410195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.411430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.427044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.427044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.427044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.427044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.427526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.427526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.562512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:24.572386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-da799e84-e1ce-44c7-b697-10fa01ff2055 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.167876 Aug 24 05:03:24.573306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 282/579] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:24 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:25.395719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:25.396450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:25.403399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.403894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.404336 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.405033 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.405670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.406103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.543239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.552559 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.559235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.559235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-82c88117-4832-4297-93ce-179c6a19e6f5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.163512 Aug 24 05:03:25.559235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 298/580] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:25 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:25.593997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:25.594672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:25.597538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:25.602292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.602783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.603227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.603909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.604426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.604815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.737605 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.746140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-25147be3-6b24-4cf5-b2d9-6484eac0e957 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.155971 Aug 24 05:03:25.746696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 283/581] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:25 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:26.577953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.578568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.585203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.586869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.586869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.586869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.587267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.587695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.717498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.726273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.727800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.728946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-af677476-eb70-4aab-8f99-1cf717accb50 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.154841 Aug 24 05:03:26.729543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 299/582] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:26 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:26.767710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.768319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.775479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.779587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.779587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.779587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.779587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.779950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.908939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.917508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ba33e9a5-a0fb-4538-b509-d3ca34c2c665 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.153559 Aug 24 05:03:26.918072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 284/583] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:26 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:27.752283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:27.752820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:27.759838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.760378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.760848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.761547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.762009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.762436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.895126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:27.903230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:27.904722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:27.905864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-828e7874-9395-4116-8564-67e1ae87374a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.157952 Aug 24 05:03:27.906417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 300/584] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:27 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:27.939686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:27.940312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:27.946796 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.947311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.947745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.948437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.948919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.949339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.077313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:28.085779 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b8437f62-a91e-4689-aa9a-88e3a3b40609 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1728 microversion: 2.1 time: 0.149889 Aug 24 05:03:28.086385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 285/585] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:27 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:28.930380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:28.931147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:28.938057 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.942144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.942144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.942144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.942144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.942701 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.083760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.091810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.093300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.094480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a6593205-cc3a-41a4-937f-3ea35af0ea68 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.168091 Aug 24 05:03:29.095074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 301/586] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:28 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:29.107700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:29.108312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:29.115256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.116552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.116552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.116835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.117288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.117711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.246280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.255166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ca445373-ff33-4ac6-bb80-1fb29510553c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1705 microversion: 2.1 time: 0.151246 Aug 24 05:03:29.255755 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 286/587] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:29 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1705 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:29.275799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:29.281802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.282333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.282776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.307662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Going to try to start instance {{(pid=122277) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:03:29.516102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4f390aa5-10c7-4f29-8b4d-11db23b7ff3e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action" status: 202 len: 0 microversion: 2.1 time: 0.244033 Aug 24 05:03:29.516702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 302/588] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:03:29 2022] POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:03:29.525682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:29.526634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:29.532770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.533258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.533693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.534391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.534913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.535372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.684711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.694775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f243ce9-05d1-4c1a-b4c6-069f4a5070f5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.172838 Aug 24 05:03:29.702519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 287/589] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:29 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:30.119511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:30.120206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:30.126475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.126960 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.127423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.128116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.128888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.129212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.260371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:30.269019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:30.270580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:30.271841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-863efb45-9a88-4449-9eb9-726728a50d7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.157107 Aug 24 05:03:30.272427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 303/590] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:30 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:30.716268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:30.716912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:30.723958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.724512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.725172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.725978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.726459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.727182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.865913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:30.874121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d56a7a06-36e4-498a-bccc-ffb3999328b5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.161695 Aug 24 05:03:30.874694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 288/591] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:30 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:31.294437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:31.295344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:31.301831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.302309 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.302742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.303464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.303924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.304347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.434737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:31.437100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:31.447797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:31.447797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:31.447797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-01ebdf32-80b8-43cd-a841-5aef9f307bfc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.156471 Aug 24 05:03:31.448124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 304/592] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:31 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:31.896464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:31.897169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:31.903612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.904092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.904524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.905256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.905708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.906130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.031480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.039795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bb738842-5df5-4649-81af-de00da1c898f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.147945 Aug 24 05:03:32.040358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 289/593] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:31 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:32.470594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:32.471169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:32.473156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:32.478895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.479415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.479854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.480548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.481003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.481432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.625077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.634502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.636282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.637595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1360a979-b48c-46a8-9ba3-7212b138099b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.171395 Aug 24 05:03:32.638436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 305/594] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:32 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:33.061483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:33.062092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:33.069151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.069636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.070072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.070765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.071261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.071747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.199999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:33.208838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-66e11666-de85-4222-9ba2-5b631cc547b8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.150537 Aug 24 05:03:33.209578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 290/595] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:33 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:33.660897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:33.661810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:33.669135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.669614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.670318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.671007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.671489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.671914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.800208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:33.808943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:33.810441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:33.811625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ef7a9a2b-4e31-44fc-b403-d69d082650a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.154660 Aug 24 05:03:33.812178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 306/596] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:33 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:34.230702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:34.231339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:34.237739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.238223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.238687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.239551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.240204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.240636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.366415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:34.374440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b22d2b3f-17aa-4512-b2f4-8fbd0da4b2ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.147660 Aug 24 05:03:34.374998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 291/597] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:34 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:34.834729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:34.835654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:34.842254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.842758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.843224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.843915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.844374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.844804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.974887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:34.983008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:34.984508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:34.985934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2a5e79a5-e7df-404e-aa44-1a57c3d9b782 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.156032 Aug 24 05:03:34.986377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 307/598] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:34 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:35.395998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:35.396738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:35.403286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:35.403773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:35.404217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:35.404996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:35.405453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:35.405882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:35.537991 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:35.546532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e90007dc-b82d-47ed-b8ce-93b7889a353d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.154504 Aug 24 05:03:35.547124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 292/599] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:35 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:36.013518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:36.014184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:36.020893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.021564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.022565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.023354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.023818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.024249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.154939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:36.163452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:36.164953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:36.166104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bf32931c-cb5a-4c10-a579-cbf740a8f935 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.156467 Aug 24 05:03:36.166667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 308/600] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:36 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:36.568051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:36.568639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:36.576000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.576480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.576907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.577585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.578034 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.578451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.710564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:36.718994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-60b19782-c044-48e8-9d09-dde0863f7fa2 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1714 microversion: 2.1 time: 0.154815 Aug 24 05:03:36.719778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 293/601] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:36 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:37.189753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:37.190390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:37.197387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.197870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.203981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.203981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.203981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.203981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.327423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:37.336260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:37.337770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:37.338930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-209986a4-27ca-407d-9150-c87bac601b80 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.153142 Aug 24 05:03:37.339514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 309/602] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:37 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:37.740908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:37.741436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:37.748020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.748496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.748929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.749609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.750054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.750469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.878218 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:37.887352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-689b7eaa-c4cb-40f9-a9f8-384c21498357 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1718 microversion: 2.1 time: 0.150312 Aug 24 05:03:37.887913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 294/603] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:37 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:38.361498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:38.362108 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:38.369606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:38.370085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:38.370521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:38.371251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:38.371712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:38.372138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:38.501048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:38.509878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:38.511474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:38.519420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2814b5d3-c56f-48bb-ac81-bda93821a3e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.154935 Aug 24 05:03:38.519420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 310/604] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:38 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:39.542154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:39.542756 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:39.549489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:39.549960 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:39.550388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:39.551139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:39.551587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:39.552002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:39.686913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:39.695095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:39.696570 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:39.697972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ce38d925-70b2-42a3-a6e0-d74363331ffb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.159795 Aug 24 05:03:39.698540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 295/605] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:39 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:40.720975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:40.721580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:40.728128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:40.728607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:40.729046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:40.729763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:40.730225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:40.730647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:40.860768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:40.869006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:40.871175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:40.872328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1ddddc0a-5fe8-425e-af8e-0e61fc2ec6ed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.155301 Aug 24 05:03:40.872888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 311/606] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:40 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:41.896170 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:41.896775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:41.903902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:41.904388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:41.904826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:41.905512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:41.905967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:41.906456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:42.032709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:42.036089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:42.041083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:42.042566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:42.045382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ef0212d0-e499-42c8-80b1-8ea1b04645d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.151517 Aug 24 05:03:42.045382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 296/607] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:41 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:43.068166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:43.068808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:43.075169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:43.075769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:43.076464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:43.077161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:43.077616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:43.078150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:43.210730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:43.219479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:43.220983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:43.222126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8d29d1f4-bac3-4839-a7f4-d4d4670d6edb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.157851 Aug 24 05:03:43.222680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 312/608] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:43 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:44.248791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:44.248791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:44.254162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:44.254641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:44.255100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:44.255783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:44.256232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:44.256694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:44.384202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:44.392847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:44.394400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:44.395690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4a1ad8f0-0b25-45bf-b0d3-12e19db166af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.154002 Aug 24 05:03:44.396431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 297/609] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:44 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:45.428924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:45.429572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:45.437572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:45.438078 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:45.438519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:45.439244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:45.439706 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:45.440135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:45.567288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:45.581516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:45.581516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:45.581516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b704b13d-235a-4893-9ed5-d6805ad3faee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.153097 Aug 24 05:03:45.581849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 313/610] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:45 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:46.601097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:46.601712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:46.608178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:46.608658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:46.609094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:46.609782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:46.610237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:46.610658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:46.741818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:46.751012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:46.752538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:46.753700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3533cef3-0106-4c8a-9219-3c481454b267 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.156520 Aug 24 05:03:46.754264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 298/611] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:46 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:47.777913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:47.778526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:47.785680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:47.786168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:47.786595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:47.787314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:47.787768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:47.789770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:47.922821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:47.931170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:47.932752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:47.934202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-88809447-2b88-40b8-8386-ce100ed9fde8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.160182 Aug 24 05:03:47.934797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 314/612] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:47 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:48.957389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:48.957995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:48.964433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:48.964921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:48.965358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:48.966053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:48.967029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:48.967574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:49.098965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:49.107714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:49.109231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:49.110381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7336543f-df41-4af8-83b1-a3313b0a9f7f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.156902 Aug 24 05:03:49.110978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 299/613] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:48 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:50.132662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:50.133342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:50.140462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:50.140941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:50.141367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:50.142063 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:50.142511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:50.142928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:50.270137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:50.278121 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:50.279649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:50.280784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-612a4e1f-f174-4a4c-a6bc-6bd9385306a1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.152167 Aug 24 05:03:50.281341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 315/614] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:50 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:51.304192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:51.304820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:51.312154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.312640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.313078 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.313771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.314229 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.314655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.447702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:51.456343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:51.457827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:51.458962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d58437a1-9dc5-498d-a5f9-c5a758861650 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.158644 Aug 24 05:03:51.459542 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 300/615] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:51 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:52.481581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:52.482261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:52.489085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:52.489552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:52.489995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:52.490658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:52.491134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:52.491555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:52.620461 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:52.629492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:52.631141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:52.632452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5289dab0-fcd2-4a24-aa67-70a1b1541316 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.154783 Aug 24 05:03:52.633010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 316/616] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:52 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:52.970711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "name": "network-vif-plugged", "status": "completed", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:52.981159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:52.981638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:52.982063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:52.994788 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] Creating event network-vif-plugged:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:03:53.000445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-56eb8198-d710-447a-8f2c-a4f1d1f172b5 req-05c07df5-24bc-4fc8-bbad-96e3fcce2518 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Aug 24 05:03:53.001047 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 301/617] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:53.657949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:53.658557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:53.665026 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.665513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.665949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.666650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.667139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.675560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.797773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:53.805985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:53.807510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:53.808655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-05861ace-1345-4296-a05d-77cdfd5dd0bd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.155119 Aug 24 05:03:53.809417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 317/618] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:53 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:54.832622 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:54.833349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:54.839896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.840385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.840822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.841514 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.841975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.842442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.982513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:54.991680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:54.993178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:54.994328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-feb4b99d-3cf6-4f9f-b420-5d42b36a04d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.166010 Aug 24 05:03:54.994878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 302/619] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:54 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:56.019646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:56.020291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:56.026871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.027414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.027854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.028553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.029029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.029460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.377271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:56.389292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:56.390828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:56.392028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ec6361fb-0d33-4e44-9cb6-69aa34b205e6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.378097 Aug 24 05:03:56.392596 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 318/620] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:56 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:56.392958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:56.393564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:56.397248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=40 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:56.400563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.401040 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.401469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.402151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.402603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.403034 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.531505 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lazy-loading 'services' on Instance uuid c457eac0-4570-4491-8e1a-d09cd8fd7d80 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:03:56.787263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d0e6fe2b-dbe2-4bd6-8c00-04407323a39b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80/os-volume_attachments/b9fe5f13-93f4-41ac-bbd0-83317a85c107" status: 202 len: 0 microversion: 2.1 time: 0.398260 Aug 24 05:03:56.787874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 303/621] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:03:56 2022] DELETE /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80/os-volume_attachments/b9fe5f13-93f4-41ac-bbd0-83317a85c107 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:03:57.415291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:57.415904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:57.422523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.423008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.423503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.424204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.424661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.425091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.560325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:57.570085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:57.575147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:57.575147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-51f2b800-8694-4c34-9e5c-00896afb2aee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1749 microversion: 2.20 time: 0.161401 Aug 24 05:03:57.575147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 319/622] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:57 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:58.598370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:58.599649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:58.607475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.608742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.614569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.614569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.614569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.614569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.897663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:58.909433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:58.911707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:58.942982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3333b2e3-6126-4ae1-97c2-8f647342c729 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.348707 Aug 24 05:03:58.945118 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 304/623] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:58 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:03:59.020426 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:59.020985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:59.027030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.027528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.028150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.029021 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.030399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.031311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.060316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:03:59.123453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:59.528190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4db9a058-37b9-4b02-812e-6a64a5a1eb73 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 204 len: 0 microversion: 2.1 time: 0.511829 Aug 24 05:03:59.530474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 320/624] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:03:59 2022] DELETE /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:03:59.538612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:59.539298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:59.549578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.557802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.558527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.559467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.561644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.562087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.786127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:59.796286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8ed6277c-a1f9-4817-a89b-45e8ab04759e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1516 microversion: 2.1 time: 0.261329 Aug 24 05:03:59.812558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 305/625] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:03:59 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:59.971584 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:59.972544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:59.983491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.984239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.984855 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.985738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.986352 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.986961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.317954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:00.332080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:00.333613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:00.334813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-76affbb0-ea8d-47cf-9acd-0770068d941a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.367752 Aug 24 05:04:00.335408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 321/626] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:03:59 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:00.818781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:00.820649 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:00.828824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.829642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.830377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.831366 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.832020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.832676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:01.075178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:01.088015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-224a2a1c-32b0-4d6e-801b-73020c2b21ba tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1516 microversion: 2.1 time: 0.273501 Aug 24 05:04:01.089252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 306/627] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:00 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:01.360898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:01.361474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:01.380704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.386030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.386678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:01.387435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.387893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.389668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:01.749598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:01.770530 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:01.771884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:01.774528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-81df7948-8fa4-42f0-bc60-613396890d29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.420662 Aug 24 05:04:01.775666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 322/628] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:01 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:02.110691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:02.111626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:02.118575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:02.119970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:02.120671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.121663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:02.125008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:02.129613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.409011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c457eac0-4570-4491-8e1a-d09cd8fd7d80", "name": "network-vif-deleted", "tag": "6582e8f7-2c4c-46ea-842e-2f3abcaf9209"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:02.422116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:02.423000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:02.423694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.437519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] Creating event network-vif-deleted:6582e8f7-2c4c-46ea-842e-2f3abcaf9209 for instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 on hv-cinder-85426 Aug 24 05:04:02.444510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-6239b9dd-8ac1-4c83-b794-19db1b0a1a72 req-d53bc59e-2768-44fc-bd5c-5da10b99a511 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039164 Aug 24 05:04:02.445664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 323/629] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:04:02.636213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:02.636213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1fe23cfb-83d3-445e-8e50-e0d76e631299 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 200 len: 1516 microversion: 2.1 time: 0.526991 Aug 24 05:04:02.636213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 307/630] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:02 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 1516 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:02.801041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:02.801747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:02.807908 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:02.808393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:02.808831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.809521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:02.809979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:02.810407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.055131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.076140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.083708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.084997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dd1fe468-c5ec-4e46-a203-e2e6407e53f0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.288500 Aug 24 05:04:03.085635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 324/631] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:02 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:03.672168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:03.672953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: c457eac0-4570-4491-8e1a-d09cd8fd7d80] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:03.687376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.689245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.690411 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.691655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.692255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.693246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.713160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] HTTP exception thrown: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Request method failure captured: Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 HTTP/1.1 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbDaZ21p6lbI6Q7vch4oN7TsTKUnIOV4eElTuc58NOaQuDlH6U118LgLqwStkOoSYlVkT133hY5Ao4rk46Z4SgETQc-Jvtd3_4pwNQuYfYrHF4PPg7gUE4UNR-zvxXs7SlOFCp5hd3UECWEJ_rdTSjkm_pobTxnxueNzPiMi4mCVgTI Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 2dd4d1addbd348c0a9608c7b3fe27157 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:04:03.716138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2dd4d1addbd348c0a9608c7b3fe27157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2dd4d1addbd348c0a9608c7b3fe27157", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2dd4d1addbd348c0a9608c7b3fe27157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2dd4d1addbd348c0a9608c7b3fe27157"}]}] Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 2dd4d1addbd348c0a9608c7b3fe27157 Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-VolumesSnapshotTestJSON-182796274-project Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 3cc9d727a1e044a397b8b8b9883d5dcb Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-VolumesSnapshotTestJSON-182796274-project Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. Aug 24 05:04:03.717520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'c457eac0-4570-4491-8e1a-d09cd8fd7d80'} Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:04:03.718347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. Aug 24 05:04:03.719614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:04:03.723780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Returning 404 to user: Instance c457eac0-4570-4491-8e1a-d09cd8fd7d80 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:04:03.724897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-84c29723-f910-4d98-8714-98ed32654801 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80" status: 404 len: 111 microversion: 2.1 time: 0.072655 Aug 24 05:04:03.729815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 308/632] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:03 2022] GET /compute/v2.1/servers/c457eac0-4570-4491-8e1a-d09cd8fd7d80 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:04:04.112374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:04.114280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:04.130608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:04.135969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:04.136342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:04.136966 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:04.137868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:04.138486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:04.140185 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:04.422999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:04.434962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:04.438928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:04.441570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-45422329-fe4f-4f53-b8b7-eeda67d3abbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.336754 Aug 24 05:04:04.445460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 325/633] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:04 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:05.469707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:05.470943 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:05.484381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.490947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.490947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.491580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.491760 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.492200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.724896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:05.740043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:05.741589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:05.742782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7f16d059-a5f0-4e7c-a400-21d94e5c1338 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.277488 Aug 24 05:04:05.750902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 309/634] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:05 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:06.774813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:06.775431 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:06.782521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:06.782997 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:06.783453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:06.784147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:06.784598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:06.785015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:06.926982 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:06.937336 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:06.939002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:06.940274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b62f08b0-30af-4fa0-a11d-820f116da886 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.169453 Aug 24 05:04:06.940939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 326/635] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:06 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:07.971369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:07.972665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:08.004275 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:08.004818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:08.005263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:08.006797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:08.007475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:08.010090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:08.417120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:08.425018 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:08.426872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:08.428309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-db6b735c-8801-49a2-a5d2-55b36cef4a59 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.466447 Aug 24 05:04:08.429361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 310/636] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:07 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:09.455435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:09.456395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:09.479957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:09.481124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:09.483661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:09.484819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:09.485386 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:09.486073 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:09.743466 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:09.753011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:09.754521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:09.768365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-00f718b3-9b05-49d5-9308-03aab3aa5ceb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.318671 Aug 24 05:04:09.769498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 327/637] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:09 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:10.797405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:10.798712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:10.816270 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:10.817264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:10.818025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:10.818989 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:10.821877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:10.822510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:11.037894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:11.051342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:11.074061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:11.075637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-77c84296-c52c-4774-bf5d-72bd39aa189c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.283005 Aug 24 05:04:11.076607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 311/638] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:10 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:12.099091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:12.099709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:12.106054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:12.106771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:12.107303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:12.108584 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:12.109214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:12.109805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:12.250048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:12.261829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:12.263305 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:12.264690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-df8359e6-846c-4633-a1f6-35b033c5475c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.169515 Aug 24 05:04:12.265242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 328/639] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:12 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:13.290791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:13.291436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:13.299089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:13.299817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:13.300388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:13.301344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:13.301810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:13.302244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:13.398309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c26026a3-71be-4dbd-96df-63764bf62be5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Action: 'create', calling method: .version_select at 0x7fde5e414f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-244626428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGeT8DtUKnZstdHfXJbhL/rfREb5DFBe20AwFTZ/rz4t4rnQw00ftkA02NHPWhtlH/1jA5COCiL4Epq10bukm/pMUyROMOh1t4gAVBUNjtJqDgD8N0bQqK/hQNaBPq/VA=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:13.414337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-c26026a3-71be-4dbd-96df-63764bf62be5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Getting quotas for project f6a6379a0607459187075dfcd968d706. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:04:13.418051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-c26026a3-71be-4dbd-96df-63764bf62be5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Getting quotas for user bfb6ab7a2f344a069010a3385d2fcf59 and project f6a6379a0607459187075dfcd968d706. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:04:13.438525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:13.447536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:13.451567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:13.451567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c7c66521-575d-43b6-905b-4a56616a4be3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.163309 Aug 24 05:04:13.451567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 329/640] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:13 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:13.528184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c26026a3-71be-4dbd-96df-63764bf62be5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.305245 Aug 24 05:04:13.535172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 312/641] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:04:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:14.474093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:14.474704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:14.481314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:14.481794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:14.482229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:14.482957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:14.484272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:14.484708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:14.638371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:14.647041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:14.648619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:14.649799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-908096fb-e924-4abe-9a54-c965890503a8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.179738 Aug 24 05:04:14.650375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 330/642] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:14 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:04:15.680700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:15.681392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:15.689242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:15.689812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:15.690546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:15.691596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:15.692122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:15.698963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:15.698963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:15.839930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:15.850959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:15.853127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:15.854465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d0123075-0c55-441b-a9b3-d839ae43bad7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.184448 Aug 24 05:04:15.855498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 313/643] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:15 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:16.809810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-745130923", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "networks": [{"uuid": "5b9c021b-a4bf-45b4-a6f8-0bf0c3f53161"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:16.867559 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] validate_networks() for [('5b9c021b-a4bf-45b4-a6f8-0bf0c3f53161', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:04:16.877842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:16.878448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:16.885539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:16.886254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:16.890879 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:16.891813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:16.892290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:16.892869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:17.117099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:17.128414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:17.129893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:17.131074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bd0650f4-fefc-49e9-adb1-493a4a2edf23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1744 microversion: 2.20 time: 0.257197 Aug 24 05:04:17.147178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 314/644] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:16 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1744 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:17.315565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:04:17.315992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:04:17.316558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:04:17.316963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:04:17.317371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:04:17.326043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:17.326517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:17.327467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:17.328490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:17.328946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:17.329372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:17.346424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Getting quotas for project 2dd4d1addbd348c0a9608c7b3fe27157. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:04:17.350334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Getting quotas for user 3cc9d727a1e044a397b8b8b9883d5dcb and project 2dd4d1addbd348c0a9608c7b3fe27157. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:04:17.361080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:04:17.363346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:04:17.474919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d38f5c9f-f3c4-41fd-aaf6-9141bc92a2d2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.668932 Aug 24 05:04:17.475663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 331/645] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:04:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 05:04:17.486514 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3bffeb0a-58fe-4162-a956-35524448eeab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:17.487190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3bffeb0a-58fe-4162-a956-35524448eeab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:17.581081 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3bffeb0a-58fe-4162-a956-35524448eeab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:17.592054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3bffeb0a-58fe-4162-a956-35524448eeab tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1222 microversion: 2.1 time: 0.109427 Aug 24 05:04:17.593048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 315/646] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:17 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:18.155532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:18.156558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:18.163790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.167658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.167658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.167658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.167658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.168012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.324475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:18.333453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:18.334971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:18.336166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-07834b4f-0c98-44df-aa32-aeffbe99b1b4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1726 microversion: 2.20 time: 0.185936 Aug 24 05:04:18.336773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 332/647] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:18 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:18.615290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:18.615878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:18.622370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.623068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.623508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.624198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.624654 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.625232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.688181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:18.697072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5339cd47-7319-46ff-b8db-3c5b81d9c6df tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1226 microversion: 2.1 time: 0.086369 Aug 24 05:04:18.697681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 316/648] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:18 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:19.360254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:19.360861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:19.367588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.368072 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.368510 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.369198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.369652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.370084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.606838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:19.616603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:19.618191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:19.619678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-beb87eeb-d552-408c-b6f1-a538aa96ce2f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1726 microversion: 2.20 time: 0.263487 Aug 24 05:04:19.620309 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 333/649] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:19 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1726 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:19.718553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:19.719202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:19.725770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.726252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.726688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.727418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.727874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.728302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.790575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:19.798400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2d36aa61-d4fc-40f6-9e3f-8cd11c75d626 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1226 microversion: 2.1 time: 0.083668 Aug 24 05:04:19.798957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 317/650] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:19 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:20.644455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:20.645984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:20.654405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.655051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.655769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.656574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.657201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.657704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.794972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:20.803497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:20.805006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:20.806161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0c04282c-b98b-479e-a108-55d651d3f2e4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1726 microversion: 2.20 time: 0.166939 Aug 24 05:04:20.806721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 334/651] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:20 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:20.819547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:20.820252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:20.826830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.827342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.827772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.828457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.828904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.829318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.890458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:20.899068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4967ba66-6146-43bc-9fc3-e43fde59c1be tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1274 microversion: 2.1 time: 0.083841 Aug 24 05:04:20.899573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 318/652] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:20 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:21.029111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "name": "network-vif-unplugged", "status": "completed", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:21.039517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.040022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.040647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.053716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] Creating event network-vif-unplugged:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:04:21.058741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-bd57c2f1-b729-416b-8577-6167ad72818a req-abf8dcef-795c-46cd-917d-270a4492615f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034207 Aug 24 05:04:21.059345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 335/653] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:21.828915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:21.829521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:21.837001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.837509 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.837956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.838658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.839165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.839593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.921574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:21.922322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:21.929434 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.929709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.930133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.930837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.931333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.931763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.095965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:22.105077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:22.106581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:22.107844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-eba4323f-1543-47db-b31d-d64c218db5bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1669 microversion: 2.20 time: 0.282982 Aug 24 05:04:22.108404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 319/654] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:21 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1669 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:22.125523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:22.130830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c5ae8098-7416-4f48-abf0-ad0ff07bffd1 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.213873 Aug 24 05:04:22.131443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 336/655] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:21 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:22.133171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36708a0c-9e25-486a-87a3-8f988d183cf6"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:22.135593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:22.142179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:22.142662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:22.143114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.143800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:22.144252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:22.144661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.937703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd76d1a-4e10-4f6d-85b8-81caeb1b243e", "tag": "18872f36-c9a7-4da6-b684-a93e77eee594"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:22.952802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:22.953399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:22.953919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.966290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] Creating event network-changed:18872f36-c9a7-4da6-b684-a93e77eee594 for instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e on hv-cinder-85426 Aug 24 05:04:22.971281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-5ae32856-92af-4ab3-9839-8813e6d6dd78 req-1ce50603-427a-4ed8-8a6e-125ee7c667b8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037252 Aug 24 05:04:22.971984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 337/656] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:04:23.153111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:23.153922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:23.160524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.161009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.161469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.162309 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.162802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.164012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.165182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-466c2eed-6740-408b-bc62-6d8eec19fd9e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.036714 Aug 24 05:04:23.165905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 320/657] 10.222.0.105 () {62 vars in 1369 bytes} [Wed Aug 24 05:04:22 2022] POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments => generated 188 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:04:23.315785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:23.317172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:23.326522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.327298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.328001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.328856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.329457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.330320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.333675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:23.342366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9d55ea66-31ec-48a7-8a9f-1ed27484217e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.193492 Aug 24 05:04:23.343546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 338/658] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:23 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:23.388940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122276) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:04:23.709363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9299970d-8a81-465c-8cab-78aa362785de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/action" status: 202 len: 0 microversion: 2.20 time: 0.399590 Aug 24 05:04:23.710227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 321/659] 10.222.0.105 () {62 vars in 1324 bytes} [Wed Aug 24 05:04:23 2022] POST /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:04:23.718093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:23.718703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:23.724547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.725030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.725494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.726188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.726634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.727086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.729853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:23.861201 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:23.870946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:23.872463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:23.873612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-259b03f8-2e5d-4f50-b628-5c4f0e09deb6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1755 microversion: 2.20 time: 0.159403 Aug 24 05:04:23.874158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 339/660] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:23 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:24.364054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:24.364776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:24.370882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:24.371468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:24.372028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:24.372867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:24.373395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:24.373862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:24.516055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:24.524102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3d156cc8-b295-4b6c-a9b2-8c7a4ec54af0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.164350 Aug 24 05:04:24.524665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 322/661] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:24 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:24.897338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:24.898848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:24.905958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:24.906443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:24.906881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:24.907605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:24.908065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:24.908522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:25.060231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:25.068919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:25.071161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:25.072248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c79672c5-d017-447a-90a1-f1d9b8bd92bb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1755 microversion: 2.20 time: 0.178837 Aug 24 05:04:25.072813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 340/662] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:24 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:25.545600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:25.546203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:25.552660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:25.553142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:25.553676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:25.554908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:25.555393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:25.555822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:25.689041 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:25.696667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-54d3dee5-10fe-4c24-9740-0cc392120fc3 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.155143 Aug 24 05:04:25.697228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 323/663] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:25 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:26.095391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:26.095994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:26.103616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.104095 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.104523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.105209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.105659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.106077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.234570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:26.243243 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:26.244727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:26.245876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c6ff3690-daa9-4bd6-8b67-de858bda2ba5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1755 microversion: 2.20 time: 0.154394 Aug 24 05:04:26.246438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 341/664] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:26 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1755 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:26.717238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:26.717813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:26.720043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:26.724740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.725334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.726399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.729360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.729360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.729360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.855333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:26.862789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-620c65a7-f28c-4ace-b3cc-2532404a06fc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.149535 Aug 24 05:04:26.863375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 324/665] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:26 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:27.270260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:27.270866 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:27.278002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.278482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.278919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:27.279636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.280093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.280516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:27.336750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:27.357279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:27.412871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:27.421676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:27.423191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:27.424333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d2e6e24e-4ba5-4b5c-ba99-ec332bbf77f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1755 microversion: 2.20 time: 0.157954 Aug 24 05:04:27.424888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 342/666] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:27 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:27.884002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:27.884612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:27.886484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:27.891811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.892299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.892738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:27.893501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.893962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.894391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:28.037011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:28.046632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-87d3d68f-1d82-490d-ad8b-376cf196f21e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.166493 Aug 24 05:04:28.047383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 325/667] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:27 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:28.449514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:28.450076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:28.456526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:28.457007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:28.457448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:28.458138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:28.458599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:28.459041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:28.591824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:28.600381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:28.602047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:28.603320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-49843c21-3b89-4b73-a2ba-c5ecc8f17e52 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1757 microversion: 2.20 time: 0.157757 Aug 24 05:04:28.603876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 343/668] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:28 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:29.067390 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:29.067998 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:29.075779 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.076340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.076776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.077469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.077938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.078352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.222898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:29.231304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-124c4933-84c7-4918-8193-cb7dd523a0e2 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.167799 Aug 24 05:04:29.231880 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 326/669] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:29 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:29.625928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:29.626474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:29.633097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.633580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.634013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.634704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.635216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.635611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.791737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:29.801136 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:29.819341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:29.819341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-63a53de7-b01f-47a3-a6a5-62e4f7237444 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.182015 Aug 24 05:04:29.819341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 344/670] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:29 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:30.252828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:30.253435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:30.260337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.260813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.261243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.261934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.262425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.262889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.266832 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:30.393886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:30.401964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e98bb6a4-1376-4e65-89cc-5445fc9200d5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.152896 Aug 24 05:04:30.402769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 327/671] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:30 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:30.728009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:04:30.728511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:04:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:04:30.835953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:30.836660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:30.843459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.843950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.844485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.845188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.845647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.846077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.974992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:30.984395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:30.986008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:30.987204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-24c2dda2-a8bf-4aac-96d6-2798f5ee7bda tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.155249 Aug 24 05:04:30.987759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 345/672] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:30 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:31.423011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:31.424071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:31.430548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:31.431046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:31.431499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:31.432196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:31.432651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:31.433071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:31.480739 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd76d1a-4e10-4f6d-85b8-81caeb1b243e", "name": "network-vif-plugged", "status": "completed", "tag": "18872f36-c9a7-4da6-b684-a93e77eee594"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:31.491339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:31.491820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:31.492876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:31.504998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] Creating event network-vif-plugged:18872f36-c9a7-4da6-b684-a93e77eee594 for instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e on hv-cinder-85426 Aug 24 05:04:31.510119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-04e315a9-918c-46a0-9fc5-52b7f0a7ab1a req-cffa92c4-a9eb-4da2-97c5-0dafbe0e9c13 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 Aug 24 05:04:31.510708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 346/673] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:04:31.605101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:31.612931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2b5b8a20-ed3f-421e-8d57-9ebef036335c tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.194396 Aug 24 05:04:31.613566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 328/674] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:31 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:32.012204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:32.012889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:32.018974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.019482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.019911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.020587 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.021034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.021458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.157066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:32.166479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:32.167994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:32.169474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0273e94a-d85c-4c9b-b707-0354af08c3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.161884 Aug 24 05:04:32.170028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 347/675] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:32 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:32.633952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:32.634740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:32.641164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.641673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.642081 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.642769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.643260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.643683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.779776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:32.787642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-75d50093-b2ca-4c77-b5a4-9eb53fb9c5b4 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.157380 Aug 24 05:04:32.788221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 329/676] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:32 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:33.194597 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:33.194597 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:33.200374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.200861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.201345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.202049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.202526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.202933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.344384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:33.355399 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:33.357261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:33.358611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a558284a-e7bf-413d-9ee6-3a9100b762de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.169962 Aug 24 05:04:33.359370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 348/677] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:33 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:33.809862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:33.810470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:33.816972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.817456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.817893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.818614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.819103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.819534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.950441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:33.958173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dc901208-d985-4006-81e8-82eac2a9428f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.152174 Aug 24 05:04:33.958803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 330/678] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:33 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:34.383266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:34.383867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:34.386881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:34.391670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.393990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.393990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:34.393990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.393990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.394354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:34.528842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:34.537279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:34.539344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:34.540841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e28e7639-c1c6-435c-9549-c776d762afba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.161486 Aug 24 05:04:34.541395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 349/679] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:34 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:34.980770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:34.981462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:34.988336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.988934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.989359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:34.990252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.990957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.991296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:35.130889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:35.139116 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c49eb2cd-675f-44de-a061-93b1a3b8cd07 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.163393 Aug 24 05:04:35.139928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 331/680] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:34 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:35.797239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:35.797851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:35.804053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:35.805492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:35.806139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:35.806864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:35.807395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:35.808007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:35.942205 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:35.950751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:35.952256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:35.953388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-78072746-090d-42ee-b739-6ccd188c587e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.392756 Aug 24 05:04:35.953985 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 350/681] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:35 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:36.160659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:36.161341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:36.168388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.168925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.169616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.170309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.170773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.171271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.311455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:36.319341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8c135d40-6f94-4b0b-b7b1-e0db9844cd70 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.162564 Aug 24 05:04:36.319913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 332/682] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:36 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:36.979532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:36.981446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:36.989158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.989634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.990066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.990787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.991267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.991715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:37.130082 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:37.140677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:37.142184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:37.143556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-30ae8b12-b19d-49f4-b100-0f39bcf24e28 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.169666 Aug 24 05:04:37.144316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 351/683] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:36 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:37.341977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:37.347480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:37.349439 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:37.349924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:37.350451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:37.351209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:37.351723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:37.352153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:37.705758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:37.714091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0721b802-8a21-45da-88fb-9402bb630ce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.376177 Aug 24 05:04:37.714665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 333/684] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:37 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:38.168311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:38.169324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:38.176639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.177218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.177725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.178632 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.179190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.180624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.315037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:38.324590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:38.326156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:38.327344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-739bc2f2-a66d-4522-a68a-07bc8bad79da tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.163706 Aug 24 05:04:38.328182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 352/685] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:38 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:38.734917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:38.735578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:38.741975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.742461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.742911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.743623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.744077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.744501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.878574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:38.887186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7f5c9451-c01c-4142-9f0d-6672d46bfce5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.156103 Aug 24 05:04:38.887777 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 334/686] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:38 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:39.350362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:39.350986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:39.357508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.357994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.358429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:39.359150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.359607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.360032 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:39.503484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:39.512951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:39.522928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:39.522928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0fe50333-5435-45a7-b88f-8629dfbbb16b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.169166 Aug 24 05:04:39.522928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 353/687] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:39 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:39.908719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:39.909356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:39.917287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.918040 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.918941 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:39.920515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.921130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.921710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:40.061468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:40.076659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-47a326b9-2e78-460d-9a0c-5676d0311b8b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.171723 Aug 24 05:04:40.077251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 335/688] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:39 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:40.545110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:40.545794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:40.552441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:40.552918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:40.553346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:40.554034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:40.555360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:40.556101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:40.702495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:40.711939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:40.713457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:40.714620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c62502b5-e483-4bd3-8f37-609d5384e517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.173884 Aug 24 05:04:40.715205 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 354/689] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:40 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:41.097505 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:41.100125 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:41.105418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.106220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.106918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.108033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.108709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.109352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.255532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:41.263351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3872488f-a03a-48f3-a720-f7b87e5c0489 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.169830 Aug 24 05:04:41.263940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 336/690] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:41 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:41.738370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:41.738963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:41.745577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.746049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.746490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.747210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.747664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.748086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.880299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:41.890186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:41.891694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:41.892836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-08b18757-836c-4a6d-9b22-1cf1d2b27cc8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.158341 Aug 24 05:04:41.893380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 355/691] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:41 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:42.284063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:42.284675 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:42.291354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.291828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.292253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.292930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.293375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.293790 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.430771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:42.438653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f0d85769-74cb-423a-b736-990f17105941 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.158342 Aug 24 05:04:42.445935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 337/692] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:42 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:42.917152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:42.917829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:42.925080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.925583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.926027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.926854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.927412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.927846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.944858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:43.074017 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:43.083288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:43.084781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:43.086468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-20509dcc-1988-4a5d-b7d3-030d52c83991 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.173974 Aug 24 05:04:43.087047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 356/693] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:42 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:43.460322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:43.461600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:43.467945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:43.468434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:43.468875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:43.469571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:43.470023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:43.470456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:43.606786 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:43.614477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8c62068c-1205-4687-a712-247d8591d833 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.158031 Aug 24 05:04:43.615061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 338/694] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:43 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:44.111180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:44.111798 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:44.118590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.119133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.119567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.120246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.120695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.121115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.266504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:44.275889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:44.277372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:44.278518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e3f83811-6388-4648-ae7f-a0627903ecf3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.171261 Aug 24 05:04:44.279094 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 357/695] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:44 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:44.638766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:44.639573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:44.647195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.647766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.648335 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.649474 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.650052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.650799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.785312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:44.793203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-079b833b-68e1-44f7-8949-c47bdc16dad0 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.161178 Aug 24 05:04:44.793769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 339/696] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:44 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:45.301782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:45.302414 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:45.309286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:45.309774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:45.310210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:45.310910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:45.311392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:45.311826 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:45.441713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:45.450541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:45.452024 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:45.453189 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-75e8c707-d3bd-46e6-9c26-fc61b6508c5d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.155451 Aug 24 05:04:45.453770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 358/697] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:45 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:45.814918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:45.815584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:45.821962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:45.822442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:45.822874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:45.823587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:45.824040 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:45.824462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:45.965473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:45.973138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-934cfaf5-3665-466c-b10f-92d9bf57ce2b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.162081 Aug 24 05:04:45.973800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 340/698] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:45 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:46.478946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:46.479552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:46.485936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:46.486418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:46.486859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:46.487574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:46.488034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:46.488457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:46.625818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:46.638279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:46.639948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:46.641355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fe5efa9b-6790-431f-a4a2-5908b4e1adbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.167007 Aug 24 05:04:46.642318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 359/699] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:46 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:46.994452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:46.995182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:47.002146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.003206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.003206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.003784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.004259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.004692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.141635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:47.150247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1676e732-acf0-4a9a-be1c-5947cc89a7a6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.160004 Aug 24 05:04:47.153266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 341/700] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:46 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:47.664819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:47.665424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:47.672132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.672605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.673031 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.673717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.674168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.674583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.738762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-37093946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-244626428", "security_groups": [{"name": "tempest-secgroup-smoke-1672163946"}], "networks": [{"uuid": "24d96d9d-6911-48d1-b9ca-f4ffb176a803"}], "block_device_mapping_v2": [{"uuid": "96c228d9-8a00-4053-8882-3576261b23f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:47.812177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:47.822644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:47.824163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:47.825541 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d80377cb-7860-44d2-bc79-4b0378a94a8b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.165216 Aug 24 05:04:47.826308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 360/701] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:47 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:47.861177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] validate_networks() for [('24d96d9d-6911-48d1-b9ca-f4ffb176a803', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:04:48.171801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:48.172419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:48.178813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.179973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.180578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.181289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.181751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.182184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.338604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:04:48.339225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:04:48.339525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:04:48.339990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:04:48.340408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:04:48.349042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.349522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.349956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.350673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.351795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.352227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.365429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:48.368744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Getting quotas for project f6a6379a0607459187075dfcd968d706. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:04:48.372691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Getting quotas for user bfb6ab7a2f344a069010a3385d2fcf59 and project f6a6379a0607459187075dfcd968d706. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:04:48.373495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1d638d9a-a52e-4460-9a06-bd96b4b24029 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.206016 Aug 24 05:04:48.374098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 361/702] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:48 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:48.429896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:04:48.432104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96c228d9-8a00-4053-8882-3576261b23f3',volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:04:48.849817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:48.850475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:48.853416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ba248505-9548-41b3-ab53-2fcc4e99c8cf tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.118407 Aug 24 05:04:48.854230 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 342/703] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:04:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 05:04:48.858687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.860920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.860920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.860920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.861215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.861686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.866091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5b984125-1b61-4a78-be9a-b431cae16d69 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:48.866779 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5b984125-1b61-4a78-be9a-b431cae16d69 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:48.941307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5b984125-1b61-4a78-be9a-b431cae16d69 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:48.950281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5b984125-1b61-4a78-be9a-b431cae16d69 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1089 microversion: 2.1 time: 0.088733 Aug 24 05:04:48.950899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 343/704] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:48 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1089 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:49.040486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:49.052174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:49.053810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:49.055683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-12fb7dac-17f6-448d-9239-af422600fe3d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.210012 Aug 24 05:04:49.056315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 362/705] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:48 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:04:49.394453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:49.395084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:49.402585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.403073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.403547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.404255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.404711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.405493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.546610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:49.554363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5993cd1d-c91b-485e-bd6d-e36fbe08efb9 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.163798 Aug 24 05:04:49.554977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 344/706] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:49 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:49.976082 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:49.976943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:49.983527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.984026 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.984994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.985141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.985639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.986060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.047825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.056389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac52733f-9c3d-4b3f-bea4-5a95ae5c7750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1139 microversion: 2.1 time: 0.084258 Aug 24 05:04:50.056950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 363/707] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:49 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:50.081473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:50.082148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:50.088317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.088799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.089239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.089924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.090376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.090800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.105414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:50.224582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.233985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.235488 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.236621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f3691acf-af47-4714-95e8-19653662243b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.159029 Aug 24 05:04:50.237173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 345/708] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:50 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:50.574420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:50.575047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:50.581087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.584128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.584128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.584128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.584128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.584485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.709409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.717695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f3b8c48d-ea41-43af-97ac-081e50a1d2f5 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.147422 Aug 24 05:04:50.718249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 364/709] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:50 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:51.077180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:51.077792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:51.084228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.084710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.085141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.086573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.087044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.087470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.147127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.155411 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8caccd39-3a65-4563-a796-96a6bf9426d4 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1139 microversion: 2.1 time: 0.082271 Aug 24 05:04:51.155975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 346/710] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:51 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:51.261098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:51.261706 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:51.268196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.268680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.269116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.269802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.270258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.270690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.401573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.410047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.411557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.412708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e99c3108-ed90-4f9c-9068-f06bdb634927 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.156463 Aug 24 05:04:51.413263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 365/711] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:51 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:51.739512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:51.740050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:51.746945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.747454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.747886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.748659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.749114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.749536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.876982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.884926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-72a0cc7c-bf21-453e-bf9b-9d7c65a0c82f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.149537 Aug 24 05:04:51.885491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 347/712] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:51 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:52.176281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:52.176994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:52.182967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.183489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.183929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.184619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.185076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.185506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.249580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:52.257911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7c295b07-4a09-448e-9b6a-dee914b1601e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1139 microversion: 2.1 time: 0.084748 Aug 24 05:04:52.258462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 366/713] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:52 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:52.436199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:52.436763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:52.443136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.443625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.444067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.445259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.445710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.446135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.571976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:52.580815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:52.582350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:52.583544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c3d021c5-7089-4a14-a3f6-3d972f126ffd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.151325 Aug 24 05:04:52.584109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 348/714] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:52 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:52.905488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:52.907185 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:52.914231 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.914712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.915179 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.915894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.916346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.917080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.061133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.067829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2d2b9987-4784-44b8-a65d-ac1a1811abe7 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.165944 Aug 24 05:04:53.068616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 367/715] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:52 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:53.278735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:53.279314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:53.285545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.286188 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.286628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.287360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.287854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.288278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.357361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.366080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b9679e85-358a-4932-adf0-9d287715016f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1187 microversion: 2.1 time: 0.090868 Aug 24 05:04:53.367711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 349/716] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:53 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:53.607303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:53.607911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:53.613865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.614375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.614813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.615520 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.615993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.616416 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.745825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.754668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.756216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.758091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-88505f7f-1bb6-4e7e-958d-5a57c649b581 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.153998 Aug 24 05:04:53.758700 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 368/717] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:53 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:54.089773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:54.090429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:54.096403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.096897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.097338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.098035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.098496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.098924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.227431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.234974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4cbf8143-31bd-4028-8c71-5901a5d103eb tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.149701 Aug 24 05:04:54.235571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 350/718] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:54 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:54.388476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:54.389079 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:54.395409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.395886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.396314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.396989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.397440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.397938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.462087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.469641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3961140e-75ae-404a-bbb3-057bb8fec3a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1195 microversion: 2.1 time: 0.084939 Aug 24 05:04:54.470198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 369/719] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:54 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1195 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:54.781360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:54.781964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:54.789152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.789638 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.790101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.790797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.791299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.791730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.922393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.932266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.933823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.934979 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-40787311-d55b-461b-8b59-4bc67f7e16ab tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.157578 Aug 24 05:04:54.935747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 351/720] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:54 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:55.255600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:55.256211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:55.262357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.262837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.263302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.263990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.264447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.264871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.393993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:55.402853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-24a02907-a951-498a-a565-2b09685b1135 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1322 microversion: 2.1 time: 0.151024 Aug 24 05:04:55.403489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 370/721] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:55 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:55.490661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:55.491259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:55.496947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.497469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.498456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.499195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.499658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.500099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.569392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:55.582672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-667c1c91-e894-4602-ab5a-0f7dcd104b0e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1205 microversion: 2.1 time: 0.092449 Aug 24 05:04:55.586009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 352/722] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:55 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:55.957299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:55.961304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:55.964044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.964525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.964959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.965647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.966099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.966565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.119699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:56.134009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:56.136010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:56.137208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ce0fb7fd-82e7-48b3-9e77-76e977dafdbb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.183841 Aug 24 05:04:56.138519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 371/723] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:55 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:56.425198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:56.425735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:56.433082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.433581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.434018 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.434775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.435216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.435643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.568805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:56.577201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c38b90f8-69d7-4336-9310-6fba26202c9a tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1511 microversion: 2.1 time: 0.156644 Aug 24 05:04:56.577765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 353/724] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:56 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:56.598047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21088f63-091f-4155-bbcd-ab1803e327e2", "device": "/dev/sdb"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:56.600092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:56.600771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:56.600925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:56.607181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.607700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.608238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.608376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.608839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.609170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.609278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.609708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.610014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.610931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:56.611486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:56.611980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:56.763397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:56.771251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6d3c202b-d36f-495d-9d41-75f2396678a5 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1273 microversion: 2.1 time: 0.174829 Aug 24 05:04:56.771832 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 354/725] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:56 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:56.839911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=100 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:57.161093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:57.161704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:57.163752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:57.168594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.170859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.170859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.170859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.171593 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.172227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.308489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:57.316999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:57.318516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:57.320761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ebb0013-2264-440a-ae38-2abc0ee3ce2d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.162609 Aug 24 05:04:57.321332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 355/726] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:57 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:04:57.381045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:57.391193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.391666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.392092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.398694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5481c952-8ee8-4192-a55e-bf5e1a4d9543 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "POST /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804509 Aug 24 05:04:57.399732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 372/727] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:04:56 2022] POST /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:57.405489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] Creating event network-changed:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:04:57.408309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-02485103-3fc7-4f2e-91df-21c104c92893 req-023fb8b4-7caa-495c-8da3-d5903a00d382 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085868 Aug 24 05:04:57.408904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 356/728] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:57.793797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:57.794764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:57.800898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.801375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.801808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.802492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.802947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.803393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.939140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:57.946946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c3172484-4827-400e-bac3-343daa636041 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.158464 Aug 24 05:04:57.950479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 373/729] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:57 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:58.345393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:58.346089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:58.353503 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.353992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.354427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:58.355163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.355626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.356056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:58.360107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:58.487153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:58.496130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:58.497663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:58.498824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-30dfa9a2-7778-4b57-b082-871f4337813f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.158505 Aug 24 05:04:58.499422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 357/730] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:58 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:04:58.967292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:58.967893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:58.974446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.974916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.975373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:58.976262 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.976839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.977261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:59.105704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:59.113444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2fde06c9-4a97-45e6-90a8-8d02fbd3ca30 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.150009 Aug 24 05:04:59.114014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 374/731] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:04:58 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:59.523178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:59.523797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:59.525613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=8 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:59.531109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:59.531631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:59.532073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:59.532793 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:59.533252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:59.533680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:59.671260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:59.680107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:59.681604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:59.682764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a0fda5a1-d5dc-4ac3-8749-221ede5be08d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.164015 Aug 24 05:04:59.683347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 358/732] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:04:59 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:00.134468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:00.135119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:00.141512 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.141994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.142450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.143168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.143627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.144051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.275675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:00.283285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d52b9c42-28a5-421c-930d-6e1d39c3e9e2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.153471 Aug 24 05:05:00.283849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 375/733] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:00 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:00.706208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:00.706832 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:00.713243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.713718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.714152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.714830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.715304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.715724 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.848553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:00.857335 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:00.858822 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:00.860012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-74d6162e-0233-416a-a3cc-4999c1a0ebed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.157624 Aug 24 05:05:00.860583 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 359/734] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:00 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:01.303331 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:01.303945 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:01.310430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.311159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.311601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:01.312392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.312856 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.313285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:01.456838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:01.467390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-302b0cc5-7132-466a-a0e0-48f7bb482b23 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.167741 Aug 24 05:05:01.475060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 376/735] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:01 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:01.884442 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:01.885043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:01.891382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.891858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.892286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:01.892967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.893418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.893943 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:02.025706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:02.034210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:02.035730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:02.036875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-061b788a-48eb-455a-b65c-39cad90d8585 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.157127 Aug 24 05:05:02.037433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 360/736] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:01 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:02.487972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:02.488582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:02.495769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:02.496293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:02.496727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:02.497418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:02.497872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:02.498288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:02.629322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:02.637570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dbfe131a-e2e7-4a41-84e7-08c93312a22a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.153413 Aug 24 05:05:02.638144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 377/737] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:02 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:03.062769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:03.063407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:03.070524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.070997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.071452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.072142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.072597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.073023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.206713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:03.216120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:03.217582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:03.218716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-246ef1e2-93eb-4bc9-91de-2e870ea4202f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.159906 Aug 24 05:05:03.219305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 361/738] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:03 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:03.484230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "name": "network-vif-plugged", "status": "completed", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:03.494623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.495289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.500204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.506260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] Creating event network-vif-plugged:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:05:03.511850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-4cc9211f-6019-4541-bc33-e4aca1cae427 req-e7a169c6-e8af-4120-b9a2-e49c1a939faf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Aug 24 05:05:03.512676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 378/739] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:03.658450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:03.659084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:03.665803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.666288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.666723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.667440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.667902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.668332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.800086 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:03.802272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:03.809677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dd2c2530-755f-44ed-8ec2-24a3925f81c8 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.155048 Aug 24 05:05:03.810353 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 362/740] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:03 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:04.242600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:04.243322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:04.249524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.250003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.250437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.251145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.251599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.252025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.384525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:04.393549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:04.395066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:04.396224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a3f6c2e7-3ee2-403c-b5d9-74dd1bf3922d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.158194 Aug 24 05:05:04.396781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 379/741] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:04 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:04.829942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:04.830556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:04.837592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.838163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.838609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.839337 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.839797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.840225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.974370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:04.982219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c269f676-80e0-4d36-b6dd-bab6e7be83d9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.156240 Aug 24 05:05:04.982792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 363/742] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:04 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:05.420664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:05.421266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:05.423670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=62 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:05.428344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:05.429623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:05.430474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:05.431196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:05.431652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:05.432072 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:05.563506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:05.572543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:05.574206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:05.575378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1437fd24-e1f9-4a27-af34-ca93953a3105 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.158772 Aug 24 05:05:05.575934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 380/743] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:05 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:06.003285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:06.004012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:06.011114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.011599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.012033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.012739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.013219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.013663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.145416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:06.153802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b7bcbf47-8fd7-4431-955e-009e3df3bf7f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.154301 Aug 24 05:05:06.154361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 364/744] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:05 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:06.599371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:06.599986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:06.606507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.606992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.607474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.608162 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.608626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.609056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.749904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:06.758797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:06.760321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:06.761512 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-39a7a9d3-0b17-4b4b-b3bb-54dc7a2306f1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.166198 Aug 24 05:05:06.762064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 381/745] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:06 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:07.174183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:07.174946 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:07.181881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:07.182371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:07.182807 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:07.183568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:07.184026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:07.184587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:07.329187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:07.338339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dd90c16c-5636-4add-9784-4c229b002e55 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.168062 Aug 24 05:05:07.338931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 365/746] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:07 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:07.784236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:07.784898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:07.792748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:07.793296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:07.793771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:07.794743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:07.795234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:07.795660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:07.958197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:07.967750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:07.969235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:07.970378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-35fe33ec-ed74-4576-a2f8-f5a0e48fc7be tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.190269 Aug 24 05:05:07.970936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 382/747] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:07 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:08.360057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:08.360673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:08.367210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:08.367692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:08.368128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:08.368817 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:08.369270 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:08.369692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:08.503724 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:08.511603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9b7f29a2-dae6-4e42-9630-e3de5c989f75 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.155394 Aug 24 05:05:08.512180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 366/748] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:08 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:09.002041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:09.002575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:09.009835 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.010320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.010872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.011836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.012292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.012716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.145481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:09.154657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:09.156153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:09.157308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-edd8bfa3-b546-4d8a-bb9c-2e949d246828 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1813 microversion: 2.20 time: 0.159196 Aug 24 05:05:09.157858 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 383/749] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:08 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:09.532024 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:09.532674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:09.539469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.539947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.540375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.541061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.541506 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.541923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.680800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:09.688581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f796de94-c503-4bce-9246-ceb6a8789c50 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.160347 Aug 24 05:05:09.689156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 367/750] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:09 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:10.181532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:10.190059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:10.190059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.190059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.190059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.190726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.191228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.191657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.321334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:10.330080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:10.333233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:10.333233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b6c6a46f-a362-458c-b5e7-a36887400531 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1800 microversion: 2.20 time: 0.155526 Aug 24 05:05:10.333480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 384/751] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:05:10 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:05:10.709013 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:10.709618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:10.716721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.717198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.717627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.718368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.718808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.719247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.856633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:10.864213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-82eb27a9-4788-456d-80b2-322fb0783fcb tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.159011 Aug 24 05:05:10.864777 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 368/752] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:10 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:11.885578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:11.886188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:11.892609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:11.893092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:11.893526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:11.894208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:11.894660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:11.895113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:12.025583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:12.033331 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-be17c75c-6221-4afa-92e6-aced723c5951 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.152365 Aug 24 05:05:12.033891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 385/753] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:11 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:13.055044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:13.055681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:13.062090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.062572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.063008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:13.063717 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.064175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.064609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:13.199873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:13.207464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-68f95b50-22db-4ab9-aa5c-5004c39d8edc tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.156881 Aug 24 05:05:13.208021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 369/754] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:13 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:13.660429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7acee8-8d46-45bf-93cc-f64522609ebb"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:13.662865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:13.669978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.670454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.670882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:13.671584 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.672033 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.672449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:14.228588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:14.229315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:14.235733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:14.236209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:14.236640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:14.237328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:14.237780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:14.238207 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:14.367776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:14.375491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fa950b9c-006e-425a-850e-0dbfba0b6040 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.151068 Aug 24 05:05:14.376062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 370/755] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:14 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:15.396279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:15.396911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:15.404000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:15.404480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:15.404906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:15.405586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:15.406036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:15.406453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:15.534401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:15.542711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ec9bee0-3177-42e5-a5f5-52a0a7c45a91 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.150269 Aug 24 05:05:15.543619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 371/756] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:15 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:16.563816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:16.564506 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:16.571683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:16.572163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:16.572591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:16.573272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:16.573951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:16.574234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:16.708516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:16.717278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-de41e529-a221-4a48-95ae-dc8a82e2e22e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.157320 Aug 24 05:05:16.717841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 372/757] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:16 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:17.077167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-413838af-7384-4bda-b70e-d3cc3d549f2b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.519213 Aug 24 05:05:17.077841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 386/758] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:05:13 2022] POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments => generated 194 bytes in 3521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:17.738156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:17.738692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:17.745406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:17.745952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:17.746385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:17.747146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:17.747608 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:17.748032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:17.883297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:17.890934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fa160311-d4b2-4abd-9ed1-7ba26c9a09ef tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.156710 Aug 24 05:05:17.891525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 373/759] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:17 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:18.392070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "name": "network-vif-plugged", "status": "completed", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:18.402640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:18.403181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:18.403689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:18.415643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] Creating event network-vif-plugged:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:05:18.420788 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-62e86623-2237-4f91-a062-5c9ac8b613ce req-83a32cdf-2c21-4b59-930c-585aa07ad1c9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086270 Aug 24 05:05:18.421415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 387/760] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:05:18.911767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:18.912432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:18.919923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:18.920404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:18.920841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:18.921571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:18.922063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:18.922448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:19.059433 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:19.067106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-06f48dd1-05af-4e42-823d-5a6812d176c0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.159093 Aug 24 05:05:19.067686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 374/761] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:18 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:20.089003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:20.089741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:20.096431 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:20.096915 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:20.097348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:20.098041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:20.098492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:20.098919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:20.114157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:20.231507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:20.239152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ab56b061-3158-4fa8-914d-0a2e31f925b1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.155010 Aug 24 05:05:20.239718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 388/762] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:20 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:21.259605 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:21.260211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:21.266586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:21.267094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:21.267529 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:21.268216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:21.268672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:21.269096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:21.403345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:21.410974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-10fdd901-cce0-44bf-a3cd-22b4a23d3321 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.155161 Aug 24 05:05:21.411531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 375/763] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:21 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:22.433137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:22.433677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:22.440404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:22.440878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:22.441310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:22.442036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:22.442488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:22.442936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:22.574093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:22.581761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7473ee89-476f-4d91-8765-cd0b220ea966 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.153264 Aug 24 05:05:22.582332 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 389/764] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:22 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:23.601966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:23.602661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:23.608975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:23.609858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:23.609858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:23.610584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:23.611058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:23.611490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:23.743391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:23.751186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-62dc93f8-b90f-437e-8ac0-c2a1cc8efe0d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.153301 Aug 24 05:05:23.751757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 376/765] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:23 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:24.771733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:24.772969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:24.779411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:24.779892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:24.780321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:24.781016 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:24.781467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:24.781887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:24.915814 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:24.923719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6cb54cc7-a492-4b35-9e58-d06e69cecd65 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.155967 Aug 24 05:05:24.924283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 390/766] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:24 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:25.944716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:25.945402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:25.951845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:25.952322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:25.952750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:25.953469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:25.953915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:25.954332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:26.087197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:26.094670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8c732ecb-c937-4861-8a00-37695601c393 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.154012 Aug 24 05:05:26.095270 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 377/767] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:25 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:27.116013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:27.116763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:27.123444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.123926 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.124358 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.125048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.125495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.125914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.261091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:27.268755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2f2ce22b-bc5e-49ee-b508-fa7398a95cae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.156670 Aug 24 05:05:27.269316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 391/768] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:27 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:27.785168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:27.787541 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:27.794906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.795426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.795867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.796625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.797089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.797521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.820580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'flavor' on Instance uuid c0487577-2a43-487f-a1a5-9efd75bf5558 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:05:27.900321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:28.152009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-17460227-5bdf-4bcb-b188-3b2c0c120e35 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/action" status: 200 len: 32 microversion: 2.1 time: 0.370795 Aug 24 05:05:28.152710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 378/769] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:05:27 2022] POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:05:28.162279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:28.162889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.169647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.170129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.170573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.171292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.171752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.172183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.289845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:28.290599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.297498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.297994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.298428 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.299225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.299643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.300070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.314704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:28.323859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a8cbd514-7c0e-4281-82bd-7db8eeac08e7 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.165367 Aug 24 05:05:28.324437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 392/770] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:28 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:28.440677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:28.448868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d3e7e2da-ee91-4977-b93d-f116e084807c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1261 microversion: 2.1 time: 0.163474 Aug 24 05:05:28.449749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 379/771] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:28 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:28.908222 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:28.908719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.915462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.915944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.916381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.917103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.917586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.918014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.043406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lazy-loading 'services' on Instance uuid 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:05:29.307039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-36a192e4-34d0-4bfa-96bc-66a58e62fd8f tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e/os-volume_attachments/21088f63-091f-4155-bbcd-ab1803e327e2" status: 202 len: 0 microversion: 2.1 time: 0.402474 Aug 24 05:05:29.307660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 393/772] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:05:28 2022] DELETE /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e/os-volume_attachments/21088f63-091f-4155-bbcd-ab1803e327e2 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:29.345303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:29.345851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:29.348402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=50 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:29.353944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.354573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.355033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.355740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.356198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.356672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.470402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:29.471318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:29.478435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.478923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.479415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.480118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.480581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.481008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.492723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:29.501651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-092e0e83-3b20-4298-8d6a-8838f62773c9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.160174 Aug 24 05:05:29.502222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 380/773] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:29 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:29.615612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:29.623648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3c5fad3d-ecf7-4770-8d43-9eb3288b07a6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1445 microversion: 2.1 time: 0.157674 Aug 24 05:05:29.624220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 394/774] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:29 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:29.649915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:29.650601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:29.656639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.657122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.657555 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.658240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.658738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.659206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.790745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:29.798677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5b49649a-e5fb-4b90-abf0-2d2c6e32e232 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1445 microversion: 2.1 time: 0.153193 Aug 24 05:05:29.799271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 381/775] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:29 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:30.523086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:30.523704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:30.530277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:30.530787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:30.531278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:30.531975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:30.532428 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:30.532854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:30.681041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:30.689965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1cfe01af-eae1-4f25-90ee-242197367c9f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.170415 Aug 24 05:05:30.690544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 395/776] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:30 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:31.482131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:31.482891 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.489668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.490201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.490707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.491655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.492190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.496902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.521056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:05:31.711086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:31.717370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.728909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.729420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.729897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.730623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.731117 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.731547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.787903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0e5a0580-e425-47b6-a9f1-4c4b88e42407 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 204 len: 0 microversion: 2.1 time: 0.309592 Aug 24 05:05:31.788503 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 382/777] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:05:31 2022] DELETE /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:05:31.797425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:31.798204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.804130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.804613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.805038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.806266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.806802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.807315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.934691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:31.943980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3d3de298-f84d-4483-9421-9ae1bcc6b03f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.236726 Aug 24 05:05:31.946872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 396/778] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:31 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:32.001488 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:32.014486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8069e43b-1bb4-4b21-982f-c7195fe32f5e tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1517 microversion: 2.1 time: 0.221119 Aug 24 05:05:32.015278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 383/779] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:31 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:32.073756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:32.083215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.083703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.084139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.095328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] Creating event network-changed:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:05:32.100441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-4e27b6eb-1e75-4678-a3c1-a6dc23d89cfe req-be659869-2b5e-45ab-ad97-5b72ad9629e9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084682 Aug 24 05:05:32.101039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 397/780] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:05:32.966696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:32.967234 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:32.973732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.974434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.974872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.975605 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.976057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.976481 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.036329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:33.037141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:33.044521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:33.045000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:33.045428 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.046118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:33.046569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:33.046988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.159220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:33.173036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-30f1f599-f62b-42d3-9768-8c6d8c342008 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.211175 Aug 24 05:05:33.173611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 384/781] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:32 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:33.207930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:33.216521 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-95588601-f5a3-4747-9ddf-27388ac78d50 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1517 microversion: 2.1 time: 0.184607 Aug 24 05:05:33.217162 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 398/782] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:33 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:34.194073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:34.194752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:34.201130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.201619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.202058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.202809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.203312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.203780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.238097 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:34.238711 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:34.245513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.246003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.246440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.247180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.247641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.248799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.396316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:34.406118 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b1ec111a-eecf-4b47-8dc0-1d35a58489f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.216102 Aug 24 05:05:34.406703 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 385/783] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:34 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:34.427339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:34.435292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ebfdb832-fba7-486f-9574-ee21786a0cbc tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1517 microversion: 2.1 time: 0.201362 Aug 24 05:05:34.436080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 399/784] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:34 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:35.341459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd76d1a-4e10-4f6d-85b8-81caeb1b243e", "name": "network-vif-deleted", "tag": "18872f36-c9a7-4da6-b684-a93e77eee594"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:35.352090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.352576 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.353007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.365367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] Creating event network-vif-deleted:18872f36-c9a7-4da6-b684-a93e77eee594 for instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e on hv-cinder-85426 Aug 24 05:05:35.370956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-17a41937-21da-48c8-9633-0d0e5c53debd req-2464c7a7-9ae3-412b-9bf4-241e70f3af60 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034157 Aug 24 05:05:35.371712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 386/785] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:35.428527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:35.429137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:35.436436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.436920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.437361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.438047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.438506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.438933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.457447 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:35.458156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:35.464809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.465316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.465749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.466440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.466895 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.467358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.533708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:35.542395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-38ea4eb5-6480-4bd8-8c96-5b455720e0e6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1475 microversion: 2.1 time: 0.088486 Aug 24 05:05:35.543499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 387/786] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:35 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1475 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:35.595041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:35.603366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-063f5cc8-4a08-47aa-adb5-2de50d137e61 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.178685 Aug 24 05:05:35.604873 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 400/787] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:35 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:36.564147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:36.570180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:36.571011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.571580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.572009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.573459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.574108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.574533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.607552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.608023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.608451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.608889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lazy-loading 'fault' on Instance uuid 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:05:36.625969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:36.626593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:36.629056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=42 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:36.633853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.636454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.636454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.636454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.636454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.636855 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.651183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc9d727a1e044a397b8b8b9883d5dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd4d1addbd348c0a9608c7b3fe27157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:36.659165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7e44137a-ff9b-460e-9a36-2746cc7e21d6 tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 200 len: 1312 microversion: 2.1 time: 0.098796 Aug 24 05:05:36.659737 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 388/788] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:36 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:36.767393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:36.775586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3372da94-065f-4c92-a75d-41357a110ed9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.153516 Aug 24 05:05:36.776183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 401/789] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:36 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:37.685054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:37.685669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] [instance: 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:37.692134 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.692621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.693060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.693747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.694205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.694632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.709236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] HTTP exception thrown: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Request method failure captured: Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e HTTP/1.1 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbDaZ21p6lbI6Q7vch4oN7TsTKUnIOV4eElTuc58NOaQuDlH6U118LgLqwStkOoSYlVkT133hY5Ao4rk46Z4SgETQc-Jvtd3_4pwNQuYfYrHF4PPg7gUE4UNR-zvxXs7SlOFCp5hd3UECWEJ_rdTSjkm_pobTxnxueNzPiMi4mCVgTI Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 2dd4d1addbd348c0a9608c7b3fe27157 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:05:37.710909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2dd4d1addbd348c0a9608c7b3fe27157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2dd4d1addbd348c0a9608c7b3fe27157", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2dd4d1addbd348c0a9608c7b3fe27157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2dd4d1addbd348c0a9608c7b3fe27157"}]}] Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 2dd4d1addbd348c0a9608c7b3fe27157 Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-182796274 Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-VolumesSnapshotTestJSON-182796274-project Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 3cc9d727a1e044a397b8b8b9883d5dcb Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-VolumesSnapshotTestJSON-182796274-project Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. Aug 24 05:05:37.712356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '4fd76d1a-4e10-4f6d-85b8-81caeb1b243e'} Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:05:37.713117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. Aug 24 05:05:37.715175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.717025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] Returning 404 to user: Instance 4fd76d1a-4e10-4f6d-85b8-81caeb1b243e could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:05:37.717025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-92d75e85-6193-44c5-b474-0ef1acc6777b tempest-VolumesSnapshotTestJSON-182796274 tempest-VolumesSnapshotTestJSON-182796274-project] 10.222.0.105 "GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e" status: 404 len: 111 microversion: 2.1 time: 0.031781 Aug 24 05:05:37.717025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 389/790] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:37 2022] GET /compute/v2.1/servers/4fd76d1a-4e10-4f6d-85b8-81caeb1b243e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:37.797734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:37.798346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:37.804677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.805306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.805748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.806435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.806903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.807334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.941216 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:37.950322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-212ff5c2-ed72-46ab-a812-2feff8fd6396 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.156473 Aug 24 05:05:37.950886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 402/791] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:37 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:38.971280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:38.971889 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:38.978310 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:38.978789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:38.979263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:38.980025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:38.980490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:38.980917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:39.109081 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:39.117237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cb04ddb2-a833-4a87-8f7a-bef69af616cf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.149815 Aug 24 05:05:39.117794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 390/792] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:38 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:40.139160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:40.139756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:40.146219 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:40.146698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:40.147167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:40.147891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:40.148350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:40.148780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:40.276380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:40.285100 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d6bd7b6-4bbe-4d89-b09b-254c6bb5d0d5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.149860 Aug 24 05:05:40.285668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 403/793] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:40 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:41.307173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:41.307811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:41.314909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:41.315423 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:41.315860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:41.316544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:41.317000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:41.317418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:41.446481 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:41.454743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b71fa86a-f307-44af-9825-482595c4efef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.151458 Aug 24 05:05:41.455348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 391/794] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:41 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:42.476908 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:42.477430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:42.485075 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:42.485558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:42.485996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:42.486693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:42.487207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:42.487634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:42.620203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:42.628650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ccf80fb4-b5fa-4968-8cca-cd1caf74fdb1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.155643 Aug 24 05:05:42.629223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 404/795] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:42 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:43.651059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:43.651716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:43.660778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:43.661264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:43.661702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:43.662400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:43.662856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:43.663313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:43.813059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:43.821506 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4aea373a-d4cc-4110-9de6-abd880266458 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.174292 Aug 24 05:05:43.822076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 392/796] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:43 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:44.195469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:44.195972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:44.202613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:44.203122 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:44.203568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:44.204257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:44.204714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:44.205138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:44.207662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:44.288286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'services' on Instance uuid 676b64f6-0ef9-4250-8e40-a7c922046984 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:05:44.466506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8870694b-85df-40b4-ad13-a76d67ff3ea7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments/35d04fda-184e-4aed-a932-c062dfc85e91" status: 202 len: 0 microversion: 2.1 time: 0.372426 Aug 24 05:05:44.467156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 405/797] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:05:44 2022] DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments/35d04fda-184e-4aed-a932-c062dfc85e91 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:44.842993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:44.843630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:44.850026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:44.850513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:44.850953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:44.851690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:44.852147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:44.852572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:44.867920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:44.988765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:44.997923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-defe0923-6f25-4ba3-8dd4-55a352c22fee tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.159367 Aug 24 05:05:44.998634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 393/798] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:44 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:46.021026 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:46.021681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:46.029206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:46.029692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:46.030132 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:46.030861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:46.031357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:46.031786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:46.169476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:46.177975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0792e8c8-e971-42ff-8b41-97cdc37e6030 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.161278 Aug 24 05:05:46.178548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 406/799] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:46 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:46.657990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:46.664715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:46.665199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:46.665710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:46.726185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Going to try to stop instance {{(pid=122276) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:05:46.928360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6e1576d2-87d1-4245-acb7-29290c42c594 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action" status: 202 len: 0 microversion: 2.1 time: 0.274343 Aug 24 05:05:46.928914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 394/800] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:05:46 2022] POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:46.937243 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:46.937867 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:46.944116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:46.944605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:46.945051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:46.945752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:46.946214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:46.946643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:47.078124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:47.086034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e961e224-db24-4c04-b212-c3139d75acda tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.152749 Aug 24 05:05:47.086860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 407/801] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:46 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:47.200767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:47.203994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:47.207789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:47.208276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:47.208714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:47.209408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:47.209870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:47.210294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:47.343740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:47.352048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-71ff3ffb-0d4d-48b9-a020-7e31c8872d24 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.156129 Aug 24 05:05:47.352612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 395/802] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:47 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:48.108446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:48.109060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:48.115775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.116286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.116782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.117495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.117979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.118408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.257220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:48.266545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a71524f6-874f-4acd-a909-26ee00082bb9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.162112 Aug 24 05:05:48.267129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 408/803] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:48 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:48.374327 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:48.375091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:48.381805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.382375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.382886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.383698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.384226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.384761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.520920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:48.529384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4fac1f92-cf47-4356-8583-b6614e96c75f tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.159459 Aug 24 05:05:48.529964 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 396/804] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:48 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:49.291323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:49.291937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:49.299320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:49.299810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:49.300252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:49.300952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:49.301412 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:49.301839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:49.449522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:49.457141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7ad7ae46-ec78-451d-9e9e-20c3321d9814 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.170048 Aug 24 05:05:49.457704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 409/805] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:49 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:49.551350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:49.551967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:49.559071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:49.559982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:49.559982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:49.560809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:49.561269 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:49.561699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:49.695313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:49.705000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0b26cd99-5dcf-4d01-98e2-25f5374922bd tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.157477 Aug 24 05:05:49.705609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 397/806] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:49 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:50.477732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:50.478338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:50.484929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.485419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.485853 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.486550 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.487040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.487456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.625044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:50.632679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b9ca30d1-50cd-4a9c-b734-3d27d081ac51 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.158906 Aug 24 05:05:50.633328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 410/807] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:50 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:50.726425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:50.726959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:50.733956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.734469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.734923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.735820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.736299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.736734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.885010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:50.888312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b4bc3e6b-7d6b-4876-b120-87fb5a2e8b19 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.165855 Aug 24 05:05:50.889090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 398/808] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:50 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:51.660374 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:51.661373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:51.673394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.674223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.674935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:51.676135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.676879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.677568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:51.874359 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:51.882312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f3750596-0faf-4592-8998-4fe78c4237fd tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.229543 Aug 24 05:05:51.882892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 411/809] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:51 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:51.915272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:51.916077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:51.923528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.924015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.924448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:51.925146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.925647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.926202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:52.083051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:52.091447 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8c80ef33-40a0-4e8c-ac18-768f3c00bf51 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.180068 Aug 24 05:05:52.092023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 399/810] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:51 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:52.904979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:52.905617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:52.912376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:52.912864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:52.913300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:52.914011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:52.914454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:52.915254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:53.050411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:53.058459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-23dfd93e-d50e-46cf-b964-854bd0f6d659 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.157835 Aug 24 05:05:53.059051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 412/811] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:52 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:53.112820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:53.113355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:53.119620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:53.120110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:53.120580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:53.121323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:53.121784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:53.122211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:53.261558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:53.270145 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-827609a2-7c7f-4797-89cb-7d2615488f5c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.161269 Aug 24 05:05:53.270754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 400/812] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:53 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:54.080240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:54.080892 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:54.088266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.088756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.089279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:54.090180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.090640 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.091091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:54.227679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:54.236208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-305ac112-bb42-4231-b38b-4833d3005239 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.159770 Aug 24 05:05:54.236713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 413/813] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:54 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:54.292573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:54.294423 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:54.301000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.301485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.301919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:54.302614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.303093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.303519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:54.430521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:54.438716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-06e737b2-e2e4-41c6-b028-4bd1c3e7e6f3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.150102 Aug 24 05:05:54.439311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 401/814] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:54 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:55.257404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:55.258018 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:55.265268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:55.265694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:55.266139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:55.266837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:55.267330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:55.267761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:55.399381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:55.407288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c997d71e-9b69-49d8-a1b7-e225cb37f6c3 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.153706 Aug 24 05:05:55.407881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 414/815] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:55 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:55.459921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:55.460521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:55.467235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:55.467717 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:55.468147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:55.468833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:55.469280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:55.469694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:55.601438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:55.610242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f544d0d6-114f-492c-b439-6c22fdc56ef2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.154176 Aug 24 05:05:55.610809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 402/816] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:55 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:56.429313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:56.429928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.436823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.437321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.437789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.438576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.439086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.446128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.576419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:56.584203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0bd3ad5d-41de-46da-9cc0-623bd8279325 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.158810 Aug 24 05:05:56.584766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 415/817] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:56 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:56.625922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:56.626455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.631717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:56.632325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.632481 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.632975 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.633418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.634112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.634571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.634999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.638996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.639517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.639946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.640666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.641117 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.641536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.659487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bcaac0fa-998e-4786-a18f-1339f955bfc4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/ips" status: 200 len: 149 microversion: 2.1 time: 0.144365 Aug 24 05:05:56.661115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 403/818] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:05:56 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/ips => generated 149 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:05:56.672178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:56.674564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.680788 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.681205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.681637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.682336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.682775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.683369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.768478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: POST /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/os-volume_attachments HTTP/1.1 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 74 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:05:56.770567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {"volumeAttachment": {"volumeId": "6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69"}} Aug 24 05:05:56.772213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'server_id': '281bea80-9e0d-435a-9fb8-6d5aa8cf3463', 'body': {'volumeAttachment': {'volumeId': '6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69'}}} Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:56.773063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:56.774294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 400 to user: Invalid volume: volume 6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 is already attached to instances: 13e6825c-7456-4e46-8158-e15a11ced942 {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-47e4422f-3648-4984-8ac0-e0673671a469 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104920 Aug 24 05:05:56.775673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 404/819] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:05:56 2022] POST /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:05:56.780823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:56.781840 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:56.782394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.789307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5eeea711-4d47-4af9-a29c-668c39ab3bc0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.161268 Aug 24 05:05:56.789458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.789881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 416/820] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:56 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:56.798274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.798274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.798274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.798274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.798667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.817923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:05:57.135256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ce7ab906-a27c-4779-8806-4d891a166bfc tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 204 len: 0 microversion: 2.1 time: 0.356889 Aug 24 05:05:57.135882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 405/821] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:05:56 2022] DELETE /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:05:57.144796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:57.145447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:57.153203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.153692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.154131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.154831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.155404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.157859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.290724 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:57.299253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-05e37cfc-9609-47e7-afa9-720069bd2894 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1684 microversion: 2.1 time: 0.158293 Aug 24 05:05:57.300034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 417/822] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:57 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:57.608608 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:57.609209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:57.615695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.616159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.616588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.617272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.617721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.618141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.765678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:57.773584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-10537c97-9fc6-450f-b14c-9ae6f6bdf385 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.170119 Aug 24 05:05:57.774245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 406/823] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:57 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:57.818011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:57.820411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:57.825481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.825970 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.826413 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.827143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.827635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.828065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.960749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:57.970182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e5b87785-0e7d-4dea-94a4-06313cf4f3f0 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.156087 Aug 24 05:05:57.972382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 418/824] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:57 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:58.321272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:58.321885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:58.329540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.330031 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.330469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.331215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.331678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.332109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.466609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:58.468950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:58.475323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ce241c49-fe10-4e0f-9b71-3e696feaac48 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1684 microversion: 2.1 time: 0.157835 Aug 24 05:05:58.475904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 407/825] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:58 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:58.795738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:58.796351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:58.801999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.802503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.802919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.803635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.804090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.804515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.936547 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:58.944433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c8bf3f2b-ab0e-488e-a6e0-9081e2da0dbc tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.152807 Aug 24 05:05:58.945005 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 419/826] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:58 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:58.993982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:58.994510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:59.002900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.003429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.003869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.004577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.005065 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.005495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.145948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:59.154275 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7dbbddf6-ee1f-4b8c-9c17-490271ea2825 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.164731 Aug 24 05:05:59.155151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 408/827] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:58 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:59.496815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:59.497425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:59.503466 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.503952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.504385 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.505075 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.505532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.505962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.642744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:59.650744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9df6883c-d7fd-4b2f-877e-217a29b8e924 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1684 microversion: 2.1 time: 0.157952 Aug 24 05:05:59.651363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 420/828] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:59 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:59.965906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:59.966678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:59.968860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.973661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.974184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.974623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.975378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.975842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.976288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.121604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:00.129719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2ee93960-ba80-4d9e-be8b-3285cd69eee6 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.167766 Aug 24 05:06:00.130312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 409/829] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:05:59 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:00.176310 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:00.176925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:00.183972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.184456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.184969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.185651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.186113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.186539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.189508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:00.334370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:00.345498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fcf0f2da-66a8-4ece-bbfe-1f56afb0978c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1736 microversion: 2.1 time: 0.172923 Aug 24 05:06:00.346092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 421/830] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:00 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:00.502286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281bea80-9e0d-435a-9fb8-6d5aa8cf3463", "name": "network-vif-deleted", "tag": "53368c46-a120-4621-b879-12464bcc2429"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:00.514102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.514872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.515539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.542156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] Creating event network-vif-deleted:53368c46-a120-4621-b879-12464bcc2429 for instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 on hv-cinder-85426 Aug 24 05:06:00.549100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-09ff4c1b-c80c-4923-95fa-1d1f08cbc20f req-cecc3785-a339-430e-a7e0-4100b6a9d753 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050333 Aug 24 05:06:00.549748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 410/831] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:00.673802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:00.674353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:00.681141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.681665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.682156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.682817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.683493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.683989 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.778324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:00.787116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-eace7419-38ba-4764-8407-33e3d61076c0 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 200 len: 1331 microversion: 2.1 time: 0.117434 Aug 24 05:06:00.787707 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 422/832] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:00 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:01.152190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:01.153189 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:01.160181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.160797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.161321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.162304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.163107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.163803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.313254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:01.322887 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2ce04b07-1e76-4cad-80e2-7f8b952f1c1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.175485 Aug 24 05:06:01.324019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 411/833] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:01 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:01.369004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:01.369812 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:01.385175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.385976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.387296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.388456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.389213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.389903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.566841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:01.576666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-711df6d3-93c0-480f-8327-8e9d16ef5dfb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1716 microversion: 2.1 time: 0.212743 Aug 24 05:06:01.587405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 423/834] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:01 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1716 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:01.666023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:01.666838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:01.676639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.677112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.677544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.678286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.678734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.679193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.773392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] HTTP exception thrown: Cannot 'detach_volume' instance c0487577-2a43-487f-a1a5-9efd75bf5558 while it is in vm_state rescued Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Request method failure captured: Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments/5d7acee8-8d46-45bf-93cc-f64522609ebb HTTP/1.1 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA5Htayi90YnrUY5eDvk84JHSPLCTE5EUlNB37aFog2OL3bdEZEFXViqEjAiKOreHiy2ek8rGVruVBR2sYLdxqMj2DFFQJEEdcRiKCSa6Etgcks_a_V-xJt7wVc3qafy9gAU66L0J0s8qdP2iUvmTjAXMS48Sk7aZ_OdyNtvdPx2Bc Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:06:01.775522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f2fd5d378aba473ab58753aecb74a065", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}] Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 51926dd0d6934aed907806a5cb14dc2f Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:06:01.777339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Cannot 'detach_volume' instance c0487577-2a43-487f-a1a5-9efd75bf5558 while it is in vm_state rescued Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'server_id': 'c0487577-2a43-487f-a1a5-9efd75bf5558', 'id': '5d7acee8-8d46-45bf-93cc-f64522609ebb'} Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:06:01.778008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c0487577-2a43-487f-a1a5-9efd75bf5558 while it is in vm_state rescued Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c0487577-2a43-487f-a1a5-9efd75bf5558 while it is in vm_state rescued Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.779290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Returning 409 to user: Cannot 'detach_volume' instance c0487577-2a43-487f-a1a5-9efd75bf5558 while it is in vm_state rescued {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:06:01.780491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7a09bf94-60b0-4004-a1b5-7e754ada15b9 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments/5d7acee8-8d46-45bf-93cc-f64522609ebb" status: 409 len: 152 microversion: 2.1 time: 0.117238 Aug 24 05:06:01.780491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 412/835] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:06:01 2022] DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments/5d7acee8-8d46-45bf-93cc-f64522609ebb => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:06:01.788961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:01.790060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:01.798020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.798546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.798944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.799676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.800129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.800550 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.809458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:01.810359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:01.816765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.817563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.818154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.819110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:01.819733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:01.820375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.836631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 HTTP/1.1 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:06:01.838588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:06:01.847117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '281bea80-9e0d-435a-9fb8-6d5aa8cf3463'} Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:06:01.848054 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:06:01.849453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:01.851297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:06:01.851297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b597310b-26ba-4e0f-b4d5-7cbf92454f49 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 404 len: 111 microversion: 2.1 time: 0.035366 Aug 24 05:06:01.851297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 413/836] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:01 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:06:01.854453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4be894d7-58b6-49a8-a7b8-a32c278d9e0d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '.version_select at 0x7fde5e254af0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:01.993684 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4be894d7-58b6-49a8-a7b8-a32c278d9e0d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061625610" status: 202 len: 0 microversion: 2.1 time: 0.143605 Aug 24 05:06:01.994264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 414/837] 10.222.0.105 () {58 vars in 1226 bytes} [Wed Aug 24 05:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061625610 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:06:02.054621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-43ab1ae8-9a54-41a7-b269-6ccbb574f499 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/action" status: 202 len: 0 microversion: 2.1 time: 0.270331 Aug 24 05:06:02.056149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 424/838] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:06:01 2022] POST /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:06:02.064740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:02.065769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:02.074425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.075182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.075713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.076494 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.077237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.077897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.250739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:02.259387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-14c19284-9282-440e-9043-2832d6889696 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1724 microversion: 2.1 time: 0.198608 Aug 24 05:06:02.263547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 415/839] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:02 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:02.346156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:02.347197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:02.353936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.354500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.355699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.356729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.357471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.358119 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.833742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:02.842880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7269eff8-a955-4185-8c0f-a28873077d1f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1682 microversion: 2.1 time: 0.501524 Aug 24 05:06:02.844286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 425/840] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:02 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:03.183854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:03.186307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:03.191357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.191948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.192291 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.192977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.193424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.193841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.277201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lazy-loading 'services' on Instance uuid 13e6825c-7456-4e46-8158-e15a11ced942 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:06:03.279824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:03.280491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:03.286465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.286949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.287420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.288115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.288574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.288995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.424321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:03.433368 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8f79d444-006b-46ef-97fa-9232ca2210ef tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1724 microversion: 2.1 time: 0.156911 Aug 24 05:06:03.434131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 426/841] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:03 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:03.541534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4cedc2a6-feb4-4c29-8fe9-619839e4acb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments/6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69" status: 202 len: 0 microversion: 2.1 time: 0.362205 Aug 24 05:06:03.542121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 416/842] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:06:03 2022] DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments/6c3672a9-0c85-4f0e-8cb1-3e95d88e3c69 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:06:03.551639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:03.553891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:03.560698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.562957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.562957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.562957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.562957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.563356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.593538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ba0439ff-cb92-47cd-9b0c-939421fc76ea tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 24 05:06:03.594017 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 427/843] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:06:03 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:03.869278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:03.869893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:03.876778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.877272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.877709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:03.878408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:03.878874 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:03.879330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.017782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:04.025663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-212bce29-cf7d-4a23-895f-7f1ffd947936 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1659 microversion: 2.1 time: 0.160720 Aug 24 05:06:04.026242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 417/844] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:03 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1659 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:04.048112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:04.054072 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.061093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.061093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.076936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Going to try to start instance {{(pid=122277) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:06:04.269854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fb910745-caed-402d-8687-db6046a01f46 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action" status: 202 len: 0 microversion: 2.1 time: 0.225662 Aug 24 05:06:04.270470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 428/845] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:06:04 2022] POST /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:06:04.279283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:04.279890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:04.286465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.286948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.287417 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.288112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.288566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.288990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.425213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:04.441484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1d51c411-7e9e-4800-8dce-a47ba768a87a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1668 microversion: 2.1 time: 0.166535 Aug 24 05:06:04.442068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 418/846] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:04 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:04.455962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:04.456747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:04.463588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.464077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.465195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.465894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.466347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.466807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.603062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:04.605935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:04.608285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:04.612070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4da2aa8d-8891-4c4b-a8e7-09658590404c tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1724 microversion: 2.1 time: 0.160177 Aug 24 05:06:04.612829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 429/847] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:04 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:04.614201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.614684 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.615144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.615833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.616286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.616704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.648286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c90b8dca-fc3f-4529-9437-90298d271500 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Aug 24 05:06:04.648764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 419/848] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:06:04 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:06:05.466563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:05.467212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:05.473893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.476787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.476787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.476787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.476787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.477152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.625568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:05.633654 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:05.634184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8ad91b0c-fbf0-4921-8004-19844fc5756c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1668 microversion: 2.1 time: 0.173020 Aug 24 05:06:05.634313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:05.634409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 430/849] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:05 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:05.642424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.642875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.647404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.647404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.647404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.647404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.661599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:05.663932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:05.670691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.671395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.671833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.672540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:05.672995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:05.673417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:05.706234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f358b3ff-531c-4863-9be9-c394404da0e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048597 Aug 24 05:06:05.706796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 431/850] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:06:05 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:06:05.775876 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:05.784938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ddfb66a4-4f18-4ab9-8921-332d1641490b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1724 microversion: 2.1 time: 0.154999 Aug 24 05:06:05.785561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 420/851] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:05 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:06.656921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:06.657529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:06.661502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=62 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:06.666634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.667194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.667885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.668634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.669089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.669763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.720138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:06.722790 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:06.730176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.730959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.731539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.732346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.732903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.733431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.768119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e2cad836-0f2f-4cec-8212-220319e2a348 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053716 Aug 24 05:06:06.769171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 421/852] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:06:06 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:06:06.808023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:06.812058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:06.816982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.817564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.818077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.818915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:06.819485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:06.819984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:06.834598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:06.844044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6ac7d696-ce16-42a9-8dd2-b0bd053f3757 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1668 microversion: 2.1 time: 0.191745 Aug 24 05:06:06.844786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 432/853] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:06 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:06.979667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:06.990624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-57ca2641-8425-408f-b6d3-fa0fe7f744c2 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1730 microversion: 2.1 time: 0.187230 Aug 24 05:06:06.995082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 422/854] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:06 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:07.015391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:07.015887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:07.021861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.022282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.022721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.023452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.023910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.024337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.114197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-feb1c566-15b3-4312-b269-f689dd838ea3 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103041 Aug 24 05:06:07.128622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 433/855] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:06:07 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:07.781543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:07.784387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:07.790519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.791010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.791594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.792210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.793277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.793711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.823545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a71f5e33-0437-4d1d-85b8-354bb23787ba tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047645 Aug 24 05:06:07.824120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 423/856] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:06:07 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:06:07.866268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:07.866884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:07.874323 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.875145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.875810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.876732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.877400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.878036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.887625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:07.888128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:07.894697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.894697 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.895167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.895865 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:07.896315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:07.896739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:07.923304 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:06:08.049177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:08.117204 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:08.126772 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4de5e387-1e55-4413-a3eb-9563c279097d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1672 microversion: 2.1 time: 0.264787 Aug 24 05:06:08.143560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 434/857] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:07 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1672 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:08.207449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:08.217782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:08.218269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:08.218703 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:08.233880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] Creating event network-changed:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:06:08.236497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-280787db-3258-49d3-8b1c-0fa3603bda61 req-95e3bef8-9999-479b-add4-760aa0d76f7f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033956 Aug 24 05:06:08.237398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 435/858] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:06:08.273402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ffe4fe7d-fbd3-4058-a09e-cdc5156788c7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 204 len: 0 microversion: 2.1 time: 0.388837 Aug 24 05:06:08.274229 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 424/859] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:06:07 2022] DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:06:08.283655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:08.284370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:08.290716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:08.291174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:08.291608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:08.292967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:08.293783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:08.294641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:08.455756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:08.458581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:08.465302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0ab5470b-a7fb-4ffe-842a-54cf445e74d7 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1683 microversion: 2.1 time: 0.185637 Aug 24 05:06:08.465961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 436/860] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:08 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:09.488522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:09.489648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:09.506354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:09.507694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:09.515585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:09.517384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:09.518958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:09.519427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:09.677954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:09.691348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9e32a9e4-bddf-4e9f-8b2f-ca41a1e32429 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1683 microversion: 2.1 time: 0.208293 Aug 24 05:06:09.691970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 425/861] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:09 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:10.253808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:10.266077 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:10.266762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:10.267181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:10.280114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] Creating event network-changed:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:06:10.285682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-d7d87dc9-2905-4a2e-bd77-62977db40c27 req-fec1ed35-01ae-4303-a58e-c06a1515f9a6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035810 Aug 24 05:06:10.286524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 437/862] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:10.597037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e6825c-7456-4e46-8158-e15a11ced942", "name": "network-vif-deleted", "tag": "3b8866d6-c018-428f-b34a-771e00bb44a7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:10.618914 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:10.619680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:10.620222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:10.637954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] Creating event network-vif-deleted:3b8866d6-c018-428f-b34a-771e00bb44a7 for instance 13e6825c-7456-4e46-8158-e15a11ced942 on hv-cinder-85426 Aug 24 05:06:10.645067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-7b1efa37-8ce7-4251-8420-3dbfa182f258 req-31cc6245-bcbf-4b6d-8e1c-69169e0ff9b2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052206 Aug 24 05:06:10.646496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 426/863] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:10.714340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:10.715474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:10.722523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:10.723012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:10.723536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:10.724443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:10.724898 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:10.725679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:10.801716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:10.810051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3d9c8ed5-ce72-4497-b8ba-7f0994197f78 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 200 len: 1616 microversion: 2.1 time: 0.099955 Aug 24 05:06:10.810631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 438/864] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:10 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 1616 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:11.833170 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:11.833870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:11.840643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:11.846115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:11.846115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:11.846115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:11.846115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:11.846554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:11.857093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 HTTP/1.1 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:06:11.858709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:06:11.860377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '13e6825c-7456-4e46-8158-e15a11ced942'} Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:06:11.861688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:06:11.863233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:11.864747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:06:11.864747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-35feef6c-e35e-41fd-b3e6-a0c0f2ec29ab tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 404 len: 111 microversion: 2.1 time: 0.031720 Aug 24 05:06:11.864747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 427/865] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:11 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:06:11.869573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-15aff7ed-eca5-418f-81c5-22eccafde40e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '.version_select at 0x7fde5e410dc0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:11.949897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-15aff7ed-eca5-418f-81c5-22eccafde40e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730240743" status: 202 len: 0 microversion: 2.1 time: 0.084463 Aug 24 05:06:11.950489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 439/866] 10.222.0.105 () {58 vars in 1223 bytes} [Wed Aug 24 05:06:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730240743 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:06:12.772209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d46f31a9-fa25-400b-9f32-647704d3b169 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: .version_select at 0x7fde5e1e2e50>, body: {"keypair": {"name": "tempest-keypair-1567652534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRehSgv9kmCfImIvWeTLIViNSI4pxgb7zrdGYSgLAwcTSKrNPgc2kuunZ4MOxxt2ybf3CZULZ4QUDqiJVFKoM6YUN5WxQEOnifFnl4KZFXwGf7ly03qLK/pIwSHRyO2BA=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:12.788881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-d46f31a9-fa25-400b-9f32-647704d3b169 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:06:12.792960 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-d46f31a9-fa25-400b-9f32-647704d3b169 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:06:12.864201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d46f31a9-fa25-400b-9f32-647704d3b169 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095673 Aug 24 05:06:12.864882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 428/867] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:06:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:15.142395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483932487", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2d7953-7d09-41eb-b20e-6de03af460a3"}], "security_groups": [{"name": "tempest-securitygroup--1548436999"}], "key_name": "tempest-keypair-1567652534", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:15.252133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] validate_networks() for [('be2d7953-7d09-41eb-b20e-6de03af460a3', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:06:15.736569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:06:15.736569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:06:15.736569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:06:15.736569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:06:15.736569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:06:15.744048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:15.744529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:15.744968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:15.746511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:15.746988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:15.747490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:15.770471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:06:15.770471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:06:15.780034 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:06:15.782370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:06:15.928749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7fb3e5a8-648c-4d42-9cd6-8aa91ae1a898 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.790830 Aug 24 05:06:15.929490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 440/868] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:06:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 05:06:15.942103 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c730bb41-6a25-40ab-ae6f-30a2d1e4fac3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:15.942883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c730bb41-6a25-40ab-ae6f-30a2d1e4fac3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:16.001734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c730bb41-6a25-40ab-ae6f-30a2d1e4fac3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:16.008807 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c730bb41-6a25-40ab-ae6f-30a2d1e4fac3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1246 microversion: 2.1 time: 0.072217 Aug 24 05:06:16.009405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 429/869] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:15 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:17.030869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:17.031498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:17.037526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:17.037995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:17.038430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:17.039200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:17.039651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:17.040070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:17.104460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:17.113170 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-725bf1d8-7957-4f16-b3df-d42c5cc066e6 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1250 microversion: 2.1 time: 0.087163 Aug 24 05:06:17.113753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 441/870] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:17 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:18.135137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:18.137425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:18.144458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:18.144948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:18.145373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:18.146443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:18.146959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:18.147628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:18.216733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:18.224461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-92bab32d-b0cd-45bf-9d52-ce6fa340c320 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1316 microversion: 2.1 time: 0.094236 Aug 24 05:06:18.225024 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 430/871] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:18 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1316 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:19.248740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:19.249345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:19.256052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:19.256492 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:19.256931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:19.257638 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:19.258126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:19.258635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:19.393306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:19.401215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e921ac82-faa2-42ff-bb0d-6640f989d13c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.157463 Aug 24 05:06:19.408489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 442/872] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:19 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:19.734186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce53a28-5b5b-4fec-a80c-c3b80329e14a", "tag": "99a6ecd8-63af-40f3-b66c-109e1f205597"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:19.744265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:19.744745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:19.745171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:19.756240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] Creating event network-changed:99a6ecd8-63af-40f3-b66c-109e1f205597 for instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a on hv-cinder-85426 Aug 24 05:06:19.761147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-17d5b123-09a4-4877-b493-219497f55926 req-aa62bdaf-7db7-4d71-b046-4cb687e9a2ba service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 Aug 24 05:06:19.763624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 431/873] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:20.422338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:20.423662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:20.429432 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:20.429911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:20.430340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:20.431050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:20.431506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:20.431924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:20.568161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:20.576657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bbee35a2-d6c9-479a-925f-186f7cfb9633 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.158696 Aug 24 05:06:20.577219 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 443/874] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:20 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:21.598392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:21.599168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:21.605287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:21.605773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:21.606780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:21.607660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:21.608037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:21.608469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:21.745669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:21.754231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c26290b9-e370-44f4-b74a-b366f66346fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.160446 Aug 24 05:06:21.754845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 432/875] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:21 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:22.775484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:22.776083 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:22.782973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:22.783485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:22.783920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:22.784614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:22.785096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:22.785524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:22.915387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:22.923239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c8ecc1ae-7738-4c50-a660-baa79729623d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.151546 Aug 24 05:06:22.923805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 444/876] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:22 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:23.944829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:23.945395 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:23.952037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:23.952541 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:23.952965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:23.953669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:23.954130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:23.954554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:24.087404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:24.095432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6f3784f5-a5f4-461a-9bdd-0f32e6f71087 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.154683 Aug 24 05:06:24.096069 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 433/877] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:23 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:25.116593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:25.117230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:25.125026 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:25.125372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:25.125850 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:25.126654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:25.127259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:25.127808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:25.266481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:25.274223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-648e67aa-fefa-460a-9ffa-dd9c790263f2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.161490 Aug 24 05:06:25.274794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 445/878] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:25 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:26.295518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:26.296112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:26.298569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:26.303468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:26.303952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:26.304387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:26.305490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:26.305952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:26.306436 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:26.438897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:26.446972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1790f723-3025-4860-a684-3da427810c75 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.155678 Aug 24 05:06:26.447568 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 434/879] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:26 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:26.634059 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce53a28-5b5b-4fec-a80c-c3b80329e14a", "name": "network-vif-plugged", "status": "completed", "tag": "99a6ecd8-63af-40f3-b66c-109e1f205597"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:26.640253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:26.640912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:26.646603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:26.647105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:26.647528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:26.660214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] Creating event network-vif-plugged:99a6ecd8-63af-40f3-b66c-109e1f205597 for instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a on hv-cinder-85426 Aug 24 05:06:26.665240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-05790688-f99a-4de0-b901-be81252a4155 req-e237b726-02c8-465a-8d15-2b50437bf850 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Aug 24 05:06:26.665820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 446/880] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:27.469254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:27.469956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:27.476632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:27.477129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:27.477556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:27.478470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:27.479053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:27.479497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:27.785845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:27.793782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b588e307-3cba-41ad-9043-e66d84e65eb8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.329140 Aug 24 05:06:27.794351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 435/881] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:27 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:06:28.817653 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:28.818346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:28.826133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:28.826691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:28.827226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:28.828053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:28.828789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:28.829256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:28.986473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:28.996725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-aa415487-b9ed-4aa9-b863-34e32a5f1c29 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1372 microversion: 2.1 time: 0.184432 Aug 24 05:06:28.997556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 447/882] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:28 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:30.020400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:30.021226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:30.027510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:30.027987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:30.028419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:30.029113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:30.029936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:30.031249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:30.174379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:30.182189 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2f0d5a08-3149-4563-b3fd-0c7d62c4e3b1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1561 microversion: 2.1 time: 0.165848 Aug 24 05:06:30.182747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 436/883] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:06:30 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:30.202956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:30.203516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:30.209904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:30.210377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:30.210807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:30.211531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:30.211983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:30.212400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:30.292658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4d3e9f22-b5b9-49c5-aa0b-c8dbf1294176 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093834 Aug 24 05:06:30.293276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 448/884] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:06:30 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:31.560338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce53a28-5b5b-4fec-a80c-c3b80329e14a", "tag": "99a6ecd8-63af-40f3-b66c-109e1f205597"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:31.568023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:31.571821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:31.572318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:31.572883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:31.586687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] Creating event network-changed:99a6ecd8-63af-40f3-b66c-109e1f205597 for instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a on hv-cinder-85426 Aug 24 05:06:31.592106 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-4d52faee-4a3a-4d03-8ed3-6a171dd24005 req-55ca280d-4571-4354-9331-b687c4c6aaed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035378 Aug 24 05:06:31.592792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 437/885] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:43.558976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:43.559890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=53 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:43.564921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:43.565415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:43.571421 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:43.571886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:43.572322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:43.573014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:43.573463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:43.573912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:43.605033 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e6d5a8cf-ec84-4307-bcf5-046b1efcf491 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments/36708a0c-9e25-486a-87a3-8f988d183cf6" status: 200 len: 194 microversion: 2.20 time: 0.047470 Aug 24 05:06:43.605727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 449/886] 10.222.0.105 () {60 vars in 1459 bytes} [Wed Aug 24 05:06:43 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments/36708a0c-9e25-486a-87a3-8f988d183cf6 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:06:43.674091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:43.678602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:43.679196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:43.685682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:43.689006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:43.689006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:43.689006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:43.689006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:43.689546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:43.771993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lazy-loading 'services' on Instance uuid ff4d90aa-1f68-4002-962b-207093b0e8dc {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:06:44.045582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3a0f2e6-ff15-4000-a73c-24f44b9a30c7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments/36708a0c-9e25-486a-87a3-8f988d183cf6" status: 202 len: 0 microversion: 2.20 time: 0.373091 Aug 24 05:06:44.046170 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 438/887] 10.222.0.105 () {60 vars in 1462 bytes} [Wed Aug 24 05:06:43 2022] DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments/36708a0c-9e25-486a-87a3-8f988d183cf6 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:06:44.055545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:44.057851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:44.065260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:44.065644 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:44.066130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:44.066857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:44.067344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:44.067771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:44.098575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-eae6af0c-048c-46d5-9998-b0536ba3febf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047332 Aug 24 05:06:44.099144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 450/888] 10.222.0.105 () {60 vars in 1348 bytes} [Wed Aug 24 05:06:44 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:06:45.113693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:45.116124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:45.122540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:45.123181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:45.123745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:45.124454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:45.124929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:45.126055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:45.156704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a3d6b3d8-8d00-480e-823c-baed7f759881 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048910 Aug 24 05:06:45.157265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 439/889] 10.222.0.105 () {60 vars in 1348 bytes} [Wed Aug 24 05:06:45 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:06:46.170106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:46.172734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:46.180504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.181168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.181592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.182294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.182752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.183214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.214694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fa86215b-a2c8-443e-8c45-14dd862b6120 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048999 Aug 24 05:06:46.215283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 451/890] 10.222.0.105 () {60 vars in 1348 bytes} [Wed Aug 24 05:06:46 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:46.279219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:46.279780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:46.286278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.286771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.287245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.287948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.288406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.288833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.314152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:06:46.646208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-92ff076b-27be-47d5-9bd1-f38e9e1464e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 204 len: 0 microversion: 2.20 time: 0.370603 Aug 24 05:06:46.646812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 440/891] 10.222.0.105 () {60 vars in 1285 bytes} [Wed Aug 24 05:06:46 2022] DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:06:46.655113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:46.655726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:46.663678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.664153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.664590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.665277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:46.665728 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:46.666181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:46.803068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:46.811107 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:46.812586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:46.813719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c6acb953-c5c0-43bc-8898-fa6557f64ff2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.162625 Aug 24 05:06:46.814282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 452/892] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:46 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:06:47.838678 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:47.839328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:47.846052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:47.846610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:47.847033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:47.847752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:47.848274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:47.848707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:47.985453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:47.994537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:47.996044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:47.997215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b7b323b2-dbb6-458e-a8d0-0e3953b2dd51 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.163182 Aug 24 05:06:47.997772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 441/893] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:47 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:06:49.021133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:49.021669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:49.028258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:49.028743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:49.029187 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:49.029887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:49.032921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:49.032921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:49.179713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:49.188061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:49.189634 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:49.190844 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e1b4a6fe-6b65-43a3-afc8-f540cd34b0ca tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1728 microversion: 2.20 time: 0.173772 Aug 24 05:06:49.191678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 453/894] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:49 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:06:49.765463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4d90aa-1f68-4002-962b-207093b0e8dc", "name": "network-vif-deleted", "tag": "915258db-6fc2-452d-a9ca-b1c79659d052"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:49.776698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:49.783130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:49.783130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:49.790222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] Creating event network-vif-deleted:915258db-6fc2-452d-a9ca-b1c79659d052 for instance ff4d90aa-1f68-4002-962b-207093b0e8dc on hv-cinder-85426 Aug 24 05:06:49.796862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-ddf3f368-a1d6-43d4-a32b-72e53fb008c3 req-733544f7-2dee-4a90-87e1-651dd6e407fb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034565 Aug 24 05:06:49.798611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 442/895] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:50.214672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:50.216602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:50.225460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:50.226020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:50.226454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:50.227210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:50.227659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:50.228076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:50.265648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:50.266038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:50.266467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:50.266914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lazy-loading 'fault' on Instance uuid ff4d90aa-1f68-4002-962b-207093b0e8dc {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:06:50.314107 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:50.324824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:50.326488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:50.328382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-10108568-dd1f-4ae6-9af1-caa55e29e9d6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 200 len: 1375 microversion: 2.20 time: 0.118042 Aug 24 05:06:50.329316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 454/896] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:50 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 1375 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:06:51.357393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:51.358072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:51.364619 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:51.365109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:51.365546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:51.366232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:51.366688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:51.367129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:51.381049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc HTTP/1.1 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:06:51.382694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:06:51.384635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'ff4d90aa-1f68-4002-962b-207093b0e8dc'} Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:06:51.385742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:06:51.387343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:06:51.388919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:06:51.388919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7f8de386-b542-4380-90c1-335ec65bf1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 404 len: 111 microversion: 2.20 time: 0.031706 Aug 24 05:06:51.388919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 443/897] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:51 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:06:51.393286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5839c923-e1ad-40c0-980d-bb5266b9ef44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '.version_select at 0x7fde5e33dee0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:51.474099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5839c923-e1ad-40c0-980d-bb5266b9ef44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055917188" status: 204 len: 0 microversion: 2.20 time: 0.084377 Aug 24 05:06:51.474600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 455/898] 10.222.0.105 () {60 vars in 1267 bytes} [Wed Aug 24 05:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055917188 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 05:06:52.241949 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b095d1b9-ccc0-42a4-b537-e9a7618de63e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: .version_select at 0x7fde62c098b0>, body: {"keypair": {"name": "tempest-keypair-705308472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiGrh8DN1WuRsVmfaI4T63N/lzojZYTeEMor9Ic3Q5aI+jY8+SQAicpaT6tPnVuvjKFFOUsLiCdeDmDfEyG4W01FuCTC81qQM0bm+KjNYxL8Hkxe0XZAwRkI2hlPceEGw=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:52.257238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-b095d1b9-ccc0-42a4-b537-e9a7618de63e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for project d373da7992054abfae0564708529a973. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:06:52.261060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-b095d1b9-ccc0-42a4-b537-e9a7618de63e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for user 842e7dea2bb24389b900d29351a0bd33 and project d373da7992054abfae0564708529a973. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:06:52.384577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b095d1b9-ccc0-42a4-b537-e9a7618de63e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.147243 Aug 24 05:06:52.385404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 444/899] 10.222.0.105 () {62 vars in 1205 bytes} [Wed Aug 24 05:06:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:06:55.197056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-160184410", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60f465a5-3648-4517-8cab-85b66f6fe49f"}], "security_groups": [{"name": "tempest-securitygroup--2127496211"}], "key_name": "tempest-keypair-705308472", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:55.300678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] validate_networks() for [('60f465a5-3648-4517-8cab-85b66f6fe49f', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:06:55.966636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:06:55.967128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:06:55.968265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:06:55.968976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:06:55.969600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:06:55.979816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:55.980343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:55.980826 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:55.981650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:55.982236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:55.982767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:56.002757 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for project d373da7992054abfae0564708529a973. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:06:56.007339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Getting quotas for user 842e7dea2bb24389b900d29351a0bd33 and project d373da7992054abfae0564708529a973. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:06:56.020686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:06:56.023553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:06:56.154397 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-70d66ce6-3c88-44dd-9319-7e3faa8a12f4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.965296 Aug 24 05:06:56.155182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 456/900] 10.222.0.105 () {62 vars in 1193 bytes} [Wed Aug 24 05:06:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 05:06:56.167277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:56.168028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:56.233102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:56.241097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:56.243774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:56.244886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-76e82d91-c301-4f76-9d59-5fad040bfd26 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1284 microversion: 2.20 time: 0.082029 Aug 24 05:06:56.245432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 445/901] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:56 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:06:57.268641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:57.269406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:57.278292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:57.278877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:57.279388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:57.280206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:57.280767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:57.281321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:57.364300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:57.376818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:57.376818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:57.377212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5dffbaf5-b4d9-4bfe-badf-f3b52ebe32d0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1288 microversion: 2.20 time: 0.114013 Aug 24 05:06:57.377831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 457/902] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:57 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:06:58.402791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:58.403509 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:58.411617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:58.412190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:58.412666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:58.414079 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:58.414627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:58.415253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:58.486162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:58.496295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:58.498860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:58.500221 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5abf776d-05be-477e-b0cb-e3da8fb2c95d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1336 microversion: 2.20 time: 0.103602 Aug 24 05:06:58.500835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 446/903] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:58 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:06:59.525459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:59.526078 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:59.532637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:59.533125 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:59.533568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:59.534268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:59.534734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:59.535209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:59.676974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:59.687603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:59.690395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:59.690395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bcee159e-bcca-437d-8acd-2cb578545095 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.168641 Aug 24 05:06:59.703528 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 458/904] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:06:59 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:00.666674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:00.678217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:00.679369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:00.679955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:00.692102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] Creating event network-changed:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:07:00.697749 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-b6f2fb16-f8d4-4704-a3c5-3f3a83e36134 req-a9bc44a2-09ff-4d87-b0f6-b7451ebce02b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Aug 24 05:07:00.698525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 447/905] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:00.715603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:00.717331 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:00.726533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:00.727814 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:00.727814 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:00.728146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:00.728552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:00.728976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:00.888830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:00.899707 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:00.901792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:00.904182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bd090eac-52c5-4945-a136-a7159b30c063 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.193543 Aug 24 05:07:00.905129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 459/906] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:00 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:01.930893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:01.931561 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:01.937986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:01.938470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:01.938904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:01.939668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:01.940125 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:01.940553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:02.087980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:02.097126 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:02.099002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:02.100971 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-676c747f-95cc-458c-885e-f32645001812 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.175252 Aug 24 05:07:02.101965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 448/907] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:01 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:03.124768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:03.125377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:03.132022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:03.132522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:03.132965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:03.133693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:03.134159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:03.134593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:03.286386 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:03.298345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:03.300050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:03.301305 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-71da6eea-5def-492d-9802-8fc82b4dc55c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.180614 Aug 24 05:07:03.301927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 460/908] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:03 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:04.326839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:04.327492 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:04.333958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:04.334432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:04.335514 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:04.336236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:04.336690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:04.337123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:04.468531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:04.478199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:04.479805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:04.480945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-08c0d51d-a8e7-4828-96e4-40ddee0eaa6f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.157969 Aug 24 05:07:04.481502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 449/909] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:04 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:05.504715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:05.505288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:05.514494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:05.515254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:05.515938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:05.516986 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:05.517747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:05.518406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:05.654144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:05.662371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:05.664202 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:05.665468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-22d43738-eee5-4e50-8f39-0fd2448d52a6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.164721 Aug 24 05:07:05.666014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 461/910] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:05 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:06.689192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:06.689788 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:06.692363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:06.698752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:06.699280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:06.699752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:06.700449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:06.700897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:06.701317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:06.858152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:06.866476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:06.871775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:06.871775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1eafe52a-fd79-4491-941d-ddecd2b3c78f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.184824 Aug 24 05:07:06.871775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 450/911] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:06 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:07.896362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:07.897196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:07.900725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:07.901919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:07.908745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:07.909375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:07.909863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:07.910679 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:07.911269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:07.911723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:08.057302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:08.065568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:08.067624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:08.069042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-491ea487-574e-4b94-bb90-224f612dfa1e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.177172 Aug 24 05:07:08.070379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 462/912] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:07 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:08.982220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "name": "network-vif-plugged", "status": "completed", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:08.993389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:08.994127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:08.994574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:09.007003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] Creating event network-vif-plugged:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:07:09.012982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-fa45bd6d-05da-4705-aebd-30b9e2f03de9 req-9b012c66-17e4-43df-a2a6-e4f8f3ce74f1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034464 Aug 24 05:07:09.013569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 451/913] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:07:09.095913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:09.099419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:09.104959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:09.105524 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:09.105968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:09.106759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:09.107326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:09.107822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:09.272911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:09.282437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:09.283958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:09.285074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a9722058-50a5-462a-a5e1-d426835900e7 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.193332 Aug 24 05:07:09.285635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 463/914] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:09 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:07:10.311688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:10.312475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:10.319324 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:10.319912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:10.320926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:10.321764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:10.322456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:10.323252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:10.470992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:10.479452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:10.480955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:10.482073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-36709f09-dcb4-44ae-884b-57e3b643d28f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.175910 Aug 24 05:07:10.482644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 452/915] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:10 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:11.506496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:11.507227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:11.515755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:11.517896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:11.517896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:11.517896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:11.518271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:11.518658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:11.665744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:11.674404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:11.676009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:11.677164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-83ad8508-3c96-4df4-ae78-883329b8c20d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1410 microversion: 2.20 time: 0.175366 Aug 24 05:07:11.677813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 464/916] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:11 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1410 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:12.702071 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:12.702685 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:12.709755 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:12.710329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:12.710869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:12.712416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:12.712909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:12.713341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:12.852591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:12.861076 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:12.862575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:12.863774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-42339567-e37e-4cca-978d-550486727287 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1603 microversion: 2.20 time: 0.166346 Aug 24 05:07:12.864369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 453/917] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:07:12 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:07:12.888050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:12.910599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:12.910599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:12.910599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:12.910599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:12.911065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:12.911065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:12.911065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:12.981972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-25e57086-9531-4639-8c61-980c1e0bf7ba tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.099084 Aug 24 05:07:12.982569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 465/918] 10.222.0.105 () {60 vars in 1321 bytes} [Wed Aug 24 05:07:12 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:07:14.063203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:14.073563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:14.074199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:14.074628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:14.078795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:14.086775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] Creating event network-changed:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:07:14.091856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-de6c5ec9-5bbc-4711-a390-8ecf8932beb3 req-b1608ec0-2342-43c9-952b-785987f02aa1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Aug 24 05:07:14.092537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 454/919] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:24.421723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:24.422482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=92 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:24.426553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:24.428819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:24.439355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.439355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.439355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.439355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.440043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.440043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.469387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2583324e-10c5-415c-9171-f62cfff48219 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049365 Aug 24 05:07:24.469952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 466/920] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:07:24 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:07:24.533789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:24.538003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:24.538606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:24.548456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.548456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.548456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.548456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.548849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.548849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.566951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:24.567468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:24.575628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.581145 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:07:24.581285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.581285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.581285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.581285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.581637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.662854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'services' on Instance uuid c0487577-2a43-487f-a1a5-9efd75bf5558 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:07:24.870974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fded829d-2fe7-4d96-9cbe-d8f0d615ba18 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 204 len: 0 microversion: 2.1 time: 0.338480 Aug 24 05:07:24.871583 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 455/921] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:07:24 2022] DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:07:24.880349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:24.881187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:24.887842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.888325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.888764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.889490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.889951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.890374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.904364 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7e6f7cdd-6f7c-4cd5-8573-3b1d20e2b053 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments/5d7acee8-8d46-45bf-93cc-f64522609ebb" status: 202 len: 0 microversion: 2.1 time: 0.341517 Aug 24 05:07:24.906769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 467/922] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:07:24 2022] DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments/5d7acee8-8d46-45bf-93cc-f64522609ebb => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:07:24.914662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:24.917378 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:24.923919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.924504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.924936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.925664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:24.926116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:24.926540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.961095 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-93c18c84-6290-40fd-86a7-0c411a06c02e tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051223 Aug 24 05:07:24.961811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 468/923] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:07:24 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:07:25.030357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:25.038098 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-de08b831-444d-4a38-b889-85a88d2a1438 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1678 microversion: 2.1 time: 0.162012 Aug 24 05:07:25.038701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 456/924] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:24 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:07:25.974220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:25.976313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:25.982889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:25.983410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:25.983860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:25.984565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:25.985024 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:25.985450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:26.016195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1a0800b1-f6b7-4762-b3af-2371de4ffe15 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 24 05:07:26.016762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 469/925] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:07:25 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:26.061687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:26.062282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:26.068679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:26.069225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:26.069660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:26.070347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:26.070803 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:26.071271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:26.202978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:26.210807 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4d475f35-7200-4574-96c3-f8c943a9a6ee tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1678 microversion: 2.1 time: 0.153667 Aug 24 05:07:26.211403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 457/926] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:26 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:27.029626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:27.031792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:27.038134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.038668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.039123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.039808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.040979 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.041857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.083921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-60008e29-dac0-4bfc-a83a-f223e8fec787 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059190 Aug 24 05:07:27.091606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 470/927] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:07:27 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:07:27.186131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:27.187315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:27.194168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.194660 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.195120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.195834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.196289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.197911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.224935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:07:27.232486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:27.235209 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:27.242058 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.242551 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.245718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.245718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.245718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.245718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.313513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:27.321183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0907cc78-405d-4eab-900c-14a804c4a371 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1610 microversion: 2.1 time: 0.093131 Aug 24 05:07:27.321796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 471/928] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:27 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:27.410437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676b64f6-0ef9-4250-8e40-a7c922046984", "name": "network-vif-deleted", "tag": "936c85cd-1e05-4281-b3e6-13b1c7718075"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:27.420807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.421280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.421767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.435959 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] Creating event network-vif-deleted:936c85cd-1e05-4281-b3e6-13b1c7718075 for instance 676b64f6-0ef9-4250-8e40-a7c922046984 on hv-cinder-85426 Aug 24 05:07:27.441344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-cd48113f-01e0-4081-b683-a82db13a5d81 req-1951f825-5447-4488-8c42-6f92db6ea0d4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034330 Aug 24 05:07:27.441939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 472/929] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:07:27.542168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-78491f93-a51c-4f44-8cd0-119a4bd8b0c4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 204 len: 0 microversion: 2.1 time: 0.361496 Aug 24 05:07:27.543426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 458/930] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:07:27 2022] DELETE /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:07:27.552689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:27.553848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:27.561863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.562485 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.562919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.563725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.564217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.564641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.710060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:27.719404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-75bc1731-e870-4386-8073-09859a154951 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1690 microversion: 2.1 time: 0.170912 Aug 24 05:07:27.719911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 473/931] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:27 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:07:28.344860 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:28.346007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:28.353878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.354507 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.355392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.356843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.357656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.358380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.447316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:28.456210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d91de626-c423-4320-933d-ab957079f09e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1325 microversion: 2.1 time: 0.116116 Aug 24 05:07:28.456787 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 459/932] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:28 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1325 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:28.742155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:28.742155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:28.749275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.749786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.750247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.750942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.751430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.751854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.886405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:28.894352 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d30a6bcf-0a9c-4ad1-b50b-927852b03184 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1690 microversion: 2.1 time: 0.157032 Aug 24 05:07:28.894919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 474/933] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:28 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:29.477955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:29.479072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:29.486038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.486535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.486977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:29.487733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.488196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.488653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:29.556331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:29.564706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0894a715-17be-44c4-915f-71be6d1069cb tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1325 microversion: 2.1 time: 0.090970 Aug 24 05:07:29.565312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 460/934] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:29 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:29.915951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:29.916562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:29.923263 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.923754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.924189 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:29.924998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.925458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.925880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:30.056824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:30.064789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d3d43b94-4132-4945-aba4-372375608820 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1690 microversion: 2.1 time: 0.152753 Aug 24 05:07:30.065430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 475/935] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:29 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:07:30.586029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:30.586700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:30.593659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:30.594130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:30.594563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:30.595282 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:30.595745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:30.596169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:30.628443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:30.628926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:30.629367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:30.629812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'fault' on Instance uuid 676b64f6-0ef9-4250-8e40-a7c922046984 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:07:30.675863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:30.686291 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a1a15c35-8cba-4b06-9f8f-8e05b90bcb59 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 200 len: 1330 microversion: 2.1 time: 0.104056 Aug 24 05:07:30.686885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 461/936] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:30 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:31.088913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:31.089962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:31.097233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.098049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.098559 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.099400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.099935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.100628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.252402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:31.261107 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f0ff30de-5526-49ee-9f93-aefdf6644b8b tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1690 microversion: 2.1 time: 0.176797 Aug 24 05:07:31.261707 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 476/937] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:31 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:31.708046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:31.708639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:31.715254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.715774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.716211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.716919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.717376 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.717804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.732707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 HTTP/1.1 Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:07:31.734401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:07:31.736287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '676b64f6-0ef9-4250-8e40-a7c922046984'} Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:07:31.741138 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:07:31.742721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:07:31.745120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:07:31.745120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-63f285ad-1496-4a4f-bf6d-176894521585 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 404 len: 111 microversion: 2.1 time: 0.031835 Aug 24 05:07:31.745120 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 462/938] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:31 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:07:31.746633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c93c1e44-f589-43ab-9829-2c26d3762e79 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '.version_select at 0x7fde5e2c39d0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:31.826889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c93c1e44-f589-43ab-9829-2c26d3762e79 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353147498" status: 202 len: 0 microversion: 2.1 time: 0.085307 Aug 24 05:07:31.827823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 477/939] 10.222.0.105 () {58 vars in 1223 bytes} [Wed Aug 24 05:07:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353147498 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:07:31.956450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0487577-2a43-487f-a1a5-9efd75bf5558", "name": "network-vif-deleted", "tag": "bdc60fa6-aa75-4b6a-8e66-263b78acb0f7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:31.970420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.970420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.970662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.987692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] Creating event network-vif-deleted:bdc60fa6-aa75-4b6a-8e66-263b78acb0f7 for instance c0487577-2a43-487f-a1a5-9efd75bf5558 on hv-cinder-85426 Aug 24 05:07:31.993940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-13e36afd-90ce-48bb-97fd-f98658e5709f req-0caaeef9-6047-442f-975b-002271d1a096 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047633 Aug 24 05:07:31.999382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 463/940] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:32.285704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:32.287110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:32.294578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:32.296464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:32.296464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:32.297362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:32.297987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:32.298581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:32.336990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:32.338053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:32.338991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:32.339497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'fault' on Instance uuid c0487577-2a43-487f-a1a5-9efd75bf5558 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:07:32.417387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:32.427522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-72b03ae8-37d9-486a-b98b-052e67a39263 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 200 len: 1339 microversion: 2.1 time: 0.148184 Aug 24 05:07:32.432852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 478/941] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:32 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:32.756526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ab0e0d3-6be8-4ff3-976b-a1da48deffd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: .version_select at 0x7fde5e225040>, body: {"keypair": {"name": "tempest-keypair-460013401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9Ulnw+JPxi30dnOyjXgizknPXYDay/FmGcu6Ji0Cyq0HwHLmPiMEvnyj6abSrQc38Zgmk2kKoWWHS+ORoXMNS9sEy0Ly9axCliMHipVO6X9lk3ZU3jJ2a3RPiMxFW6w=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:32.775315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-7ab0e0d3-6be8-4ff3-976b-a1da48deffd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for project bd6824ae6edd43fcbddb58581134098c. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:07:32.780435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-7ab0e0d3-6be8-4ff3-976b-a1da48deffd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for user b11da4dac5804252b7310be096ae5d53 and project bd6824ae6edd43fcbddb58581134098c. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:07:32.889353 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ab0e0d3-6be8-4ff3-976b-a1da48deffd4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137146 Aug 24 05:07:32.889945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 464/942] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:07:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:33.450419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:33.451104 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: c0487577-2a43-487f-a1a5-9efd75bf5558] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:33.457624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:33.458098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:33.458533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:33.459258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:33.459717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:33.460143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:33.476113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] HTTP exception thrown: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Request method failure captured: Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 HTTP/1.1 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA5Htayi90YnrUY5eDvk84JHSPLCTE5EUlNB37aFog2OL3bdEZEFXViqEjAiKOreHiy2ek8rGVruVBR2sYLdxqMj2DFFQJEEdcRiKCSa6Etgcks_a_V-xJt7wVc3qafy9gAU66L0J0s8qdP2iUvmTjAXMS48Sk7aZ_OdyNtvdPx2Bc Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:07:33.477702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f2fd5d378aba473ab58753aecb74a065", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}] Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 51926dd0d6934aed907806a5cb14dc2f Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. Aug 24 05:07:33.479267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'c0487577-2a43-487f-a1a5-9efd75bf5558'} Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:07:33.481518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. Aug 24 05:07:33.484628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:33.486731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Returning 404 to user: Instance c0487577-2a43-487f-a1a5-9efd75bf5558 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:07:33.486731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-de55322a-09e0-4d35-9db9-36209bf110cc tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558" status: 404 len: 111 microversion: 2.1 time: 0.033298 Aug 24 05:07:33.486731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 479/943] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:33 2022] GET /compute/v2.1/servers/c0487577-2a43-487f-a1a5-9efd75bf5558 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:07:33.492267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ba94875e-4de3-4825-8784-d5faf212a1f1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '.version_select at 0x7fde5e3a8c10>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:33.575317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ba94875e-4de3-4825-8784-d5faf212a1f1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874707577" status: 202 len: 0 microversion: 2.1 time: 0.086937 Aug 24 05:07:33.576017 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 465/944] 10.222.0.105 () {58 vars in 1226 bytes} [Wed Aug 24 05:07:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874707577 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:07:35.368074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-229844750", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa68ee2b-4e61-41de-a187-732b5be326be"}], "security_groups": [{"name": "tempest-securitygroup--407362465"}], "key_name": "tempest-keypair-460013401", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:35.495427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] validate_networks() for [('fa68ee2b-4e61-41de-a187-732b5be326be', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:07:36.146407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:07:36.146903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:07:36.147417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:07:36.147871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:07:36.148240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:07:36.157317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:36.157794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:36.158225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:36.159116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:36.159573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:36.159996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:36.177702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for project bd6824ae6edd43fcbddb58581134098c. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:07:36.182324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Getting quotas for user b11da4dac5804252b7310be096ae5d53 and project bd6824ae6edd43fcbddb58581134098c. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:07:36.194168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:07:36.197333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:07:36.355127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d4be24f9-fc3d-4efa-9420-1714fd0a0e57 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.991610 Aug 24 05:07:36.355761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 480/945] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:07:35 2022] POST /compute/v2.1/servers => generated 403 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:07:36.368292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-01cc701e-6997-406e-8319-26cede327986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:36.369751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-01cc701e-6997-406e-8319-26cede327986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:36.433908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-01cc701e-6997-406e-8319-26cede327986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:36.442151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-01cc701e-6997-406e-8319-26cede327986 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1240 microversion: 2.1 time: 0.078515 Aug 24 05:07:36.442816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 466/946] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:36 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:37.034020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:37.034637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:37.042785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.043261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.043897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.058903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.058903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.058903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.071884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:07:37.447852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7145c7be-0ad4-41b0-9b43-5455645ea032 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 204 len: 0 microversion: 2.1 time: 0.417193 Aug 24 05:07:37.448498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 481/947] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:07:37 2022] DELETE /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:07:37.456472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:37.457160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:37.465159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.466917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.466917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.467190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:37.467297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.467393 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:37.467498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.467852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.473067 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.473532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.473990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.474692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:37.475180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:37.475605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:37.564708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:37.568284 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:37.573003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-97fefdf5-dea3-4c6d-95a6-d1acb9640cf8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1244 microversion: 2.1 time: 0.111401 Aug 24 05:07:37.573584 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 482/948] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:37 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:37.630002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:37.638369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2498311d-0472-4705-ae32-c11989b22430 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1512 microversion: 2.1 time: 0.185654 Aug 24 05:07:37.647061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 467/949] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:37 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:38.595290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:38.596189 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:38.610311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:38.610916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:38.611451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:38.612273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:38.612854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:38.613285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:38.663961 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:38.665526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:38.672782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:38.673406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:38.673879 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:38.674877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:38.675533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:38.676199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:38.689297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:38.698666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3fd5618d-d4da-42d8-b3be-b3010885619e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1300 microversion: 2.1 time: 0.107738 Aug 24 05:07:38.700649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 483/950] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:38 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:38.827471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:38.836687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-58252085-ea60-448a-85cf-e66a9d171cdf tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1512 microversion: 2.1 time: 0.177351 Aug 24 05:07:38.838320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 468/951] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:38 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:39.277382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4225d1-b115-4951-a361-2118e0bf3022", "name": "network-vif-deleted", "tag": "8a56cc43-f19d-4e76-ba1f-7968609999dd"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:39.295249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:39.296235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:39.296829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:39.313203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] Creating event network-vif-deleted:8a56cc43-f19d-4e76-ba1f-7968609999dd for instance 6f4225d1-b115-4951-a361-2118e0bf3022 on hv-cinder-85426 Aug 24 05:07:39.318581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-143ff6fe-d69b-4ae4-824e-4f4ac7be3a6d req-dc65bace-a62b-4eda-aa65-e88fb36430a9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044849 Aug 24 05:07:39.319285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 484/952] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:39.720747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:39.721360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:39.727845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:39.728338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:39.728771 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:39.729761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:39.730222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:39.730823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:39.859463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:39.860182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:39.866694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:39.867223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:39.867918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:39.869153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:39.870046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:39.870705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:39.875794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:39.887806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9c3d9681-6b81-45f9-8d80-caf445ee42e1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.170926 Aug 24 05:07:39.895180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 469/953] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:39 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:40.074922 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:40.075471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:40.076255 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:40.076392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'fault' on Instance uuid 6f4225d1-b115-4951-a361-2118e0bf3022 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:07:40.123870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:40.133067 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b6240151-6e55-40a8-bb9d-41c9f3008206 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 200 len: 1316 microversion: 2.1 time: 0.278789 Aug 24 05:07:40.134075 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 485/954] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:39 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:07:40.911239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:40.912102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:40.918751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:40.919397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:40.919912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:40.920628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:40.921325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:40.921746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.062931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:41.070741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f65bd00-eba5-4ff6-b32b-7417352fa8c0 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.164173 Aug 24 05:07:41.071347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 470/955] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:40 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:41.156449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:41.161735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: 6f4225d1-b115-4951-a361-2118e0bf3022] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:41.164315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.164813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.165291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.166618 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.167112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.167542 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.183876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] HTTP exception thrown: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Request method failure captured: Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 HTTP/1.1 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA5Htayi90YnrUY5eDvk84JHSPLCTE5EUlNB37aFog2OL3bdEZEFXViqEjAiKOreHiy2ek8rGVruVBR2sYLdxqMj2DFFQJEEdcRiKCSa6Etgcks_a_V-xJt7wVc3qafy9gAU66L0J0s8qdP2iUvmTjAXMS48Sk7aZ_OdyNtvdPx2Bc Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:07:41.185552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f2fd5d378aba473ab58753aecb74a065", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}] Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 51926dd0d6934aed907806a5cb14dc2f Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. Aug 24 05:07:41.186891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '6f4225d1-b115-4951-a361-2118e0bf3022'} Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:07:41.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. Aug 24 05:07:41.188967 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:41.190047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Returning 404 to user: Instance 6f4225d1-b115-4951-a361-2118e0bf3022 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:07:41.190047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9432564a-7519-4651-a46e-67e5f97eb52a tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022" status: 404 len: 111 microversion: 2.1 time: 0.034822 Aug 24 05:07:41.190047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 486/956] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:41 2022] GET /compute/v2.1/servers/6f4225d1-b115-4951-a361-2118e0bf3022 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:07:41.195698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:41.196211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:41.202612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.203149 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.203650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.204377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.204847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.205278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.234003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:07:41.251535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:41.333477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248db6cc-ec73-4414-811e-f609ddab4135", "tag": "a548c47d-2d76-4053-b9e8-abe497478a7b"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:41.343682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.344165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.344600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.355984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] Creating event network-changed:a548c47d-2d76-4053-b9e8-abe497478a7b for instance 248db6cc-ec73-4414-811e-f609ddab4135 on hv-cinder-85426 Aug 24 05:07:41.360722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-96897cae-f683-4e0d-9996-f4830299d690 req-4f36b929-5949-4066-8408-dcdeff10194a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030879 Aug 24 05:07:41.361296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 487/957] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:07:41.590530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e5c19976-1a52-4332-be48-3163642bd2cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 204 len: 0 microversion: 2.1 time: 0.398485 Aug 24 05:07:41.591142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 471/958] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:07:41 2022] DELETE /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:07:41.605142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:41.605840 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:41.612246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.612598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.613206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.613906 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:41.614367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:41.614790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:41.748264 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:41.756245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8b651f72-2401-48a8-942b-18556074e4cb tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.155453 Aug 24 05:07:41.756809 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 488/959] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:41 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:42.093068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:42.093767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:42.100226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:42.100737 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:42.101174 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:42.101863 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:42.102320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:42.102805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:42.240794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:42.249233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a85f58c4-29b7-4fe3-8b52-6a433dab215d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.160625 Aug 24 05:07:42.249804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 472/960] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:42 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:42.778923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:42.779569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:42.785925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:42.786408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:42.786842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:42.787557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:42.788014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:42.788438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:42.921146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:42.929147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-def14f81-702c-4f08-b422-31f080911dc4 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.154667 Aug 24 05:07:42.929712 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 489/961] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:42 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:43.271216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:43.271842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:43.279582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:43.280066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:43.280498 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:43.281196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:43.281650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:43.282073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:43.414430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:43.423691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0dedd646-2d17-42e8-a9e7-75d684e08168 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.156281 Aug 24 05:07:43.424269 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 473/962] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:43 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:43.951600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:43.952361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:43.959356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:43.959918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:43.960362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:43.961054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:43.961502 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:43.961920 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:44.102613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:44.112279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e8d264b0-6830-4720-aab4-8d217ed762d1 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.166339 Aug 24 05:07:44.112851 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 490/963] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:43 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:44.445942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:44.446528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:44.454042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:44.454524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:44.454955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:44.455679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:44.456129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:44.456550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:44.591933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:44.595211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fec72a72-8430-4a63-839c-94bdc596b4de tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.153277 Aug 24 05:07:44.595794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 474/964] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:44 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:45.134618 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:45.135312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:45.142116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:45.142619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:45.143083 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:45.143825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:45.144277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:45.144701 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:45.291599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:45.307250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafe7c72-03ed-4290-b32a-f2ea4cea4b5b", "name": "network-vif-deleted", "tag": "7d5c8ebf-0828-4896-8dfd-0ddc4b429c21"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:45.312362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0866f5dc-8ec9-41f3-9997-f43970931417 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1525 microversion: 2.1 time: 0.171121 Aug 24 05:07:45.314208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 491/965] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:45 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:45.317368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:45.317823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:45.318248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:45.331265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] Creating event network-vif-deleted:7d5c8ebf-0828-4896-8dfd-0ddc4b429c21 for instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b on hv-cinder-85426 Aug 24 05:07:45.336186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-4476afc9-c3e5-410c-b263-92120193cca4 req-2c946382-cd9b-4e61-836b-1019fbd0e427 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Aug 24 05:07:45.337551 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 475/966] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:45.616931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:45.617855 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:45.624901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:45.625389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:45.625856 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:45.626617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:45.627300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:45.627890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:45.775773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:45.783894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b71dbe61-c118-4853-838c-2eab677df37b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.170714 Aug 24 05:07:45.784448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 492/967] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:45 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:46.335560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:46.336259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:46.342883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:46.343410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:46.343880 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:46.344584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:46.345045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:46.345572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:46.379716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:46.380281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:46.380673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:46.381119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lazy-loading 'fault' on Instance uuid dafe7c72-03ed-4290-b32a-f2ea4cea4b5b {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:07:46.424934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51926dd0d6934aed907806a5cb14dc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2fd5d378aba473ab58753aecb74a065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:46.433056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c9ed5ac4-1865-446a-a335-efc3637c3ab5 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 200 len: 1315 microversion: 2.1 time: 0.101950 Aug 24 05:07:46.433631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 476/968] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:46 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 1315 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:46.804817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:46.805404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:46.808020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:46.808688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:46.813690 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:46.814160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:46.814601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:46.815325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:46.815781 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:46.816206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:46.954260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:46.961930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d1cb9ec9-caec-4d99-9eab-9be74fed35b1 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.160926 Aug 24 05:07:46.962494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 493/969] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:46 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:47.127396 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248db6cc-ec73-4414-811e-f609ddab4135", "name": "network-vif-plugged", "status": "completed", "tag": "a548c47d-2d76-4053-b9e8-abe497478a7b"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:47.132418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:47.138393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:47.138871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:47.139332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:47.151864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] Creating event network-vif-plugged:a548c47d-2d76-4053-b9e8-abe497478a7b for instance 248db6cc-ec73-4414-811e-f609ddab4135 on hv-cinder-85426 Aug 24 05:07:47.157097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-09a275ba-47ea-45cc-8160-d03fce818604 req-c34b69ee-5a57-4c16-a4a2-a22440cdb9d5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Aug 24 05:07:47.157892 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 477/970] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:47.455133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:47.456055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] [instance: dafe7c72-03ed-4290-b32a-f2ea4cea4b5b] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:47.462407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:47.462893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:47.467398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:47.467398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:47.467398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:47.467398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:47.481604 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] HTTP exception thrown: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Request method failure captured: Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b HTTP/1.1 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA5Htayi90YnrUY5eDvk84JHSPLCTE5EUlNB37aFog2OL3bdEZEFXViqEjAiKOreHiy2ek8rGVruVBR2sYLdxqMj2DFFQJEEdcRiKCSa6Etgcks_a_V-xJt7wVc3qafy9gAU66L0J0s8qdP2iUvmTjAXMS48Sk7aZ_OdyNtvdPx2Bc Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:07:47.483308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f2fd5d378aba473ab58753aecb74a065", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f2fd5d378aba473ab58753aecb74a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f2fd5d378aba473ab58753aecb74a065"}]}] Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: f2fd5d378aba473ab58753aecb74a065 Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1254875468 Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 51926dd0d6934aed907806a5cb14dc2f Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1254875468-project Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. Aug 24 05:07:47.485066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'dafe7c72-03ed-4290-b32a-f2ea4cea4b5b'} Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:07:47.489684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. Aug 24 05:07:47.491737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:07:47.493126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] Returning 404 to user: Instance dafe7c72-03ed-4290-b32a-f2ea4cea4b5b could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:07:47.493126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9f8d19ef-f48c-49ec-b306-38a653df0750 tempest-ServerRescueNegativeTestJSON-1254875468 tempest-ServerRescueNegativeTestJSON-1254875468-project] 10.222.0.105 "GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b" status: 404 len: 111 microversion: 2.1 time: 0.033608 Aug 24 05:07:47.493126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 494/971] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:47 2022] GET /compute/v2.1/servers/dafe7c72-03ed-4290-b32a-f2ea4cea4b5b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:07:47.985151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:47.986016 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:47.993361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:47.993855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:47.994295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:47.995139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:47.995862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:47.996298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:48.144070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:48.152986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-eb760798-3d0a-4d8b-8869-1c95d0de1a89 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.172142 Aug 24 05:07:48.153581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 478/972] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:47 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:49.186828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:49.192462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:49.202606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:49.202606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:49.202606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:49.202606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:49.203096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:49.203096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:49.338874 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:49.347147 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d8ad036f-95f8-4f65-a52c-c252a3ae5ab9 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1365 microversion: 2.1 time: 0.171156 Aug 24 05:07:49.347702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 495/973] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:49 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:50.370176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:50.371405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:50.377994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:50.378465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:50.378908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:50.379629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:50.380093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:50.380522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:50.597933 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:50.606402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f9ca1027-bce6-4af6-86e2-6e5b3e2def7f tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1551 microversion: 2.1 time: 0.240176 Aug 24 05:07:50.606940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 479/974] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:07:50 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1551 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:50.629111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:50.629646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:50.636153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:50.636827 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:50.637379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:50.638110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:50.638569 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:50.639066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:50.726400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-135e0f6d-53dd-42cc-b1a4-cfb3342a9c08 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101443 Aug 24 05:07:50.726995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 496/975] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:07:50 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:52.136708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248db6cc-ec73-4414-811e-f609ddab4135", "tag": "a548c47d-2d76-4053-b9e8-abe497478a7b"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:52.151676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:52.152491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:52.153445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:52.175325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] Creating event network-changed:a548c47d-2d76-4053-b9e8-abe497478a7b for instance 248db6cc-ec73-4414-811e-f609ddab4135 on hv-cinder-85426 Aug 24 05:07:52.186016 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-8cdf7528-15fb-4a59-b5bb-b0ee519bcb96 req-502fc277-e2cb-43dd-a28a-8d82d5909ae9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052455 Aug 24 05:07:52.187345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 480/976] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:53.926672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:53.927265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:53.933983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:53.934470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:53.934961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:53.935684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:53.936138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:53.936564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:53.959828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2d971f86-75d6-484c-a8e5-f3ece61d2a4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/ips" status: 200 len: 149 microversion: 2.1 time: 0.037812 Aug 24 05:07:53.960389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 497/977] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:07:53 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:55.530621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e1b23dd0-545c-48f2-a1e1-15b6b060495c tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e225d30>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:55.596598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e1b23dd0-545c-48f2-a1e1-15b6b060495c tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/1794e2d6-dc70-463e-8a4e-410d5dadb223" status: 200 len: 351 microversion: 2.1 time: 0.073910 Aug 24 05:07:55.597261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 481/978] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:07:55 2022] GET /compute/v2.1/os-volumes/1794e2d6-dc70-463e-8a4e-410d5dadb223 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:56.710129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a34a18fc-4900-4a5f-8ade-035a9924c8fe"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:56.712642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:56.715871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:56.720691 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:56.721335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:56.721777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:56.722761 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:56.723392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:56.723961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:57.248166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-99fb85ec-7a6b-4de5-be53-acb718b83412 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde62c09c10>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:57.295198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-99fb85ec-7a6b-4de5-be53-acb718b83412 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/bd05dde5-0bb7-4025-af25-36ad33b5866a" status: 200 len: 350 microversion: 2.1 time: 0.051250 Aug 24 05:07:57.295628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 482/979] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:07:57 2022] GET /compute/v2.1/os-volumes/bd05dde5-0bb7-4025-af25-36ad33b5866a => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:57.570051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-874fedb7-4c17-4f44-901a-45b9d3724e4e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864724 Aug 24 05:07:57.570573 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 498/980] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:07:56 2022] POST /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:07:59.888567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:59.889115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:07:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:07:59.947830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7d136572-d7c2-447a-843a-9217db8e8674 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e3c7040>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:59.995457 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7d136572-d7c2-447a-843a-9217db8e8674 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/9b3500b2-67a7-4c43-b4fb-1ba43b42debb" status: 200 len: 349 microversion: 2.1 time: 0.052459 Aug 24 05:07:59.996036 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 483/981] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:07:59 2022] GET /compute/v2.1/os-volumes/9b3500b2-67a7-4c43-b4fb-1ba43b42debb => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:00.009951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ca626266-437a-4d6c-9b41-bf6b4dddcbb9 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e1999d0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.100369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ca626266-437a-4d6c-9b41-bf6b4dddcbb9 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.094933 Aug 24 05:08:00.100936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 499/982] 10.222.0.105 () {58 vars in 1139 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:00.114702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ed7bddc0-1a1e-48de-a4c3-5706bbf1c7ea tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde62c09820>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.203668 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ed7bddc0-1a1e-48de-a4c3-5706bbf1c7ea tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.092618 Aug 24 05:08:00.204252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 484/983] 10.222.0.105 () {58 vars in 1154 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:00.218446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-87e6dae6-0f49-4a15-b60c-1c1639fe5f33 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e336670>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.305656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-87e6dae6-0f49-4a15-b60c-1c1639fe5f33 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.092070 Aug 24 05:08:00.306226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 500/984] 10.222.0.105 () {58 vars in 1139 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:00.319486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d28b9f94-db90-4090-acaa-392cdfe27298 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e2d6160>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.406809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d28b9f94-db90-4090-acaa-392cdfe27298 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091038 Aug 24 05:08:00.407413 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 485/985] 10.222.0.105 () {58 vars in 1172 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:00.432276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fe89c999-b6a4-4717-9740-8640b633b601 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e336430>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.518545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fe89c999-b6a4-4717-9740-8640b633b601 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.100876 Aug 24 05:08:00.519587 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 501/986] 10.222.0.105 () {58 vars in 1175 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:00.532734 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-da62859b-d698-4484-b22a-a49a3bd6ca5b tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde62c17e50>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.616169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-da62859b-d698-4484-b22a-a49a3bd6ca5b tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087234 Aug 24 05:08:00.616740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 486/987] 10.222.0.105 () {58 vars in 1160 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:00.630461 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-17cf5c36-46bb-46d3-b10c-3db793955a34 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e6de790>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.718849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-17cf5c36-46bb-46d3-b10c-3db793955a34 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092279 Aug 24 05:08:00.719438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 502/988] 10.222.0.105 () {58 vars in 1193 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:00.732735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b37e59cd-2f08-4380-b168-29e57effd295 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] Calling method '.version_select at 0x7fde5e2d69d0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:00.821718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b37e59cd-2f08-4380-b168-29e57effd295 tempest-VolumesTestJSON-1829276996 tempest-VolumesTestJSON-1829276996-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093401 Aug 24 05:08:00.822318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 487/989] 10.222.0.105 () {58 vars in 1160 bytes} [Wed Aug 24 05:08:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:03.645897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:03.646548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:03.654004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:03.654606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:03.654999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:03.655722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:03.656178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:03.656603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:03.685969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lazy-loading 'flavor' on Instance uuid 11f2c50c-6e43-4245-a8a2-b7455d391882 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:08:03.829957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:04.053890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b976d1ff-5d6a-4e3b-921c-1ab3cdba7670 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "POST /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882/action" status: 202 len: 0 microversion: 2.1 time: 0.412253 Aug 24 05:08:04.054479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 503/990] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:08:03 2022] POST /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:08:04.060523 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:04.061380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:04.065535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:04.066199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:04.073039 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:04.073526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:04.074046 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:04.075327 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:04.076101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:04.076686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:04.218342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:04.226249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-92c2979b-ba45-4317-a35d-4637347f970a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.167319 Aug 24 05:08:04.226825 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 488/991] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:04 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:05.249869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:05.250693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:05.257328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:05.257938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:05.258459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:05.259309 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:05.259840 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:05.260338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:05.404327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:05.412465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3da3e8b1-fe40-4707-8109-e32c7788e609 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.168272 Aug 24 05:08:05.413388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 504/992] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:05 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:06.173281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a34a18fc-4900-4a5f-8ade-035a9924c8fe"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:06.175870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:06.183095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.183667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.184170 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.190005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.190005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.190005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.269585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: POST /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments HTTP/1.1 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 74 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:08:06.271444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {"volumeAttachment": {"volumeId": "a34a18fc-4900-4a5f-8ade-035a9924c8fe"}} Aug 24 05:08:06.273020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'server_id': '7ce53a28-5b5b-4fec-a80c-c3b80329e14a', 'body': {'volumeAttachment': {'volumeId': 'a34a18fc-4900-4a5f-8ade-035a9924c8fe'}}} Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:08:06.273990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:06.275438 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 400 to user: Invalid volume: volume a34a18fc-4900-4a5f-8ade-035a9924c8fe is already attached to instances: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0f0ac28d-7d23-47c8-9906-7e5cb8891ae2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106449 Aug 24 05:08:06.277268 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 489/993] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:08:06 2022] POST /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:08:06.347859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:06.348499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:06.356738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.356738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.357552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.358319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.358797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.359416 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.435658 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:06.436201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:06.443548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.447199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.447199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.447199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.447199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.447607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.451274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lazy-loading 'services' on Instance uuid 7ce53a28-5b5b-4fec-a80c-c3b80329e14a {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:08:06.594437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:06.602468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ba97425d-8db2-467a-9dca-faa0a78a8dbe tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.172573 Aug 24 05:08:06.603471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 490/994] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:06 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:06.670375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0e775e50-41e3-4906-91f5-2fd577b72e8f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments/a34a18fc-4900-4a5f-8ade-035a9924c8fe" status: 202 len: 0 microversion: 2.1 time: 0.326212 Aug 24 05:08:06.671471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 505/995] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:08:06 2022] DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments/a34a18fc-4900-4a5f-8ade-035a9924c8fe => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:08:06.681088 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:06.683608 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:06.690938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.691473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.691908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.692611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:06.693074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:06.693502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:06.726674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-db354718-5b44-4b9a-b973-f19aa39b1f9e tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050477 Aug 24 05:08:06.731566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 491/996] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:08:06 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:07.626581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:07.627413 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:07.634467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:07.635249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:07.635693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:07.636430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:07.636871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:07.637324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:07.739611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:07.741900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:07.749096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:07.749587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:07.750022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:07.750724 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:07.751216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:07.751644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:07.783766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9b69a1ea-2522-4590-bc9e-d6d4219bcdd3 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Aug 24 05:08:07.784331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 492/997] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:08:07 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:08:07.816348 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:07.825726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5fa06bb1-8d4d-464a-8acc-b38164d8f5dd tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.203119 Aug 24 05:08:07.826060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 506/998] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:07 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:08.797506 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:08.799927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:08.806816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.807339 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.807885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.808499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.808956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.809974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.842441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a557968f-1bee-4588-b455-774a3ab75804 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049982 Aug 24 05:08:08.843586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 493/999] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:08:08 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 05:08:08.848719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:08.849307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:08.855608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.856240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.857340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.858114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.858641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.859163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.908077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:08.908581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:08.914604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.915146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.915635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.916370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:08.916820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:08.917300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:08.944917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:08:09.043293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:09.051713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-873eedc3-6c52-4e37-9430-770a05860c5e tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.207592 Aug 24 05:08:09.052279 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 507/1000] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:08 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:09.271456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cc0d44c5-a908-47d5-9865-878ade738a96 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 204 len: 0 microversion: 2.1 time: 0.366886 Aug 24 05:08:09.272200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 494/1001] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:08:08 2022] DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:08:09.285342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:09.286341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:09.296088 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:09.297176 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:09.298678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:09.300102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:09.300900 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:09.301652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:09.506548 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:09.514750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-52078ab4-95f6-4b7c-97c0-304591dc2a63 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1686 microversion: 2.1 time: 0.236486 Aug 24 05:08:09.515560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 508/1002] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:09 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1686 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:10.074656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:10.076062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:10.082782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.083298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.083761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.084468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.084922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.085348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.238538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:10.247056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9bab386b-d6c3-49f2-a2d7-9a3741a58357 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.176903 Aug 24 05:08:10.247710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 495/1003] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:10 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:10.536795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:10.537535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:10.544252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.544884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.545360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.546096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.546816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.547281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.720735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:10.728474 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4408d8b6-d531-4896-85c5-f28abc5c3bb2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1686 microversion: 2.1 time: 0.195759 Aug 24 05:08:10.729092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 509/1004] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:10 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:11.268403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:11.269014 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:11.275611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:11.276092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:11.276598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:11.277222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:11.277683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:11.278629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:11.518878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:11.526783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-adc3c5a0-c765-43f9-9d4d-43f33a32bb1a tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.262209 Aug 24 05:08:11.527386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 496/1005] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:11 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:11.753684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:11.754813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:11.762452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:11.762452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:11.762718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:11.763515 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:11.764080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:11.764576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:11.957987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:11.967555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dd5019c4-f2b6-42a1-b2a3-8397461abd93 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1686 microversion: 2.1 time: 0.220768 Aug 24 05:08:11.968142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 510/1006] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:11 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1686 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:12.553482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:12.554292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:12.566883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:12.567607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:12.568251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:12.569467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:12.570314 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:12.572235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:12.586809 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce53a28-5b5b-4fec-a80c-c3b80329e14a", "name": "network-vif-deleted", "tag": "99a6ecd8-63af-40f3-b66c-109e1f205597"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:12.605484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:12.607278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:12.608149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:12.621316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] Creating event network-vif-deleted:99a6ecd8-63af-40f3-b66c-109e1f205597 for instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a on hv-cinder-85426 Aug 24 05:08:12.635783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-28ba5009-e4c0-4c4b-89ac-4e08ec807e21 req-b33692a9-9ffc-4dff-87a3-ae87db10832f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050282 Aug 24 05:08:12.635783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 511/1007] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:08:12.771967 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:12.780201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f06dd0c-2276-4b55-8bd8-76f50901b2ae tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.233789 Aug 24 05:08:12.780782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 497/1008] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:12 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:12.989983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:12.990791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:12.998029 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:12.999352 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:12.999889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:13.000966 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:13.001504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:13.001927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:13.039952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:13.040440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:13.040889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:13.041329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lazy-loading 'fault' on Instance uuid 7ce53a28-5b5b-4fec-a80c-c3b80329e14a {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:08:13.091616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:13.101896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-267535ee-e1c0-46fb-a582-be6ea53e5549 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 200 len: 1336 microversion: 2.1 time: 0.116233 Aug 24 05:08:13.111973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 512/1009] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:12 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:13.802156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:13.802762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:13.809154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:13.810904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:13.810904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:13.811920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:13.812374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:13.812794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:13.948845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:13.961397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b93d89b4-59f0-4417-95e2-7829b5114895 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.159033 Aug 24 05:08:13.961397 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 498/1010] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:13 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:14.126995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:14.127662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:14.134133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:14.134472 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:14.134910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:14.135660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:14.136115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:14.136736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:14.150505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a HTTP/1.1 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:08:14.152238 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:08:14.154514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '7ce53a28-5b5b-4fec-a80c-c3b80329e14a'} Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:08:14.155935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:08:14.157950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:08:14.159447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:08:14.159447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5566ebe7-8bb2-4f7d-a07f-e01a1f7c8f07 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 404 len: 111 microversion: 2.1 time: 0.031042 Aug 24 05:08:14.159447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 513/1011] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:14 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:08:14.164885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-85b3d43b-8925-4097-93f3-df5a3499ca06 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '.version_select at 0x7fde5e225430>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:14.276090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-85b3d43b-8925-4097-93f3-df5a3499ca06 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567652534" status: 202 len: 0 microversion: 2.1 time: 0.115163 Aug 24 05:08:14.276683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 499/1012] 10.222.0.105 () {58 vars in 1226 bytes} [Wed Aug 24 05:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567652534 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:08:14.979164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:14.979787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:14.986632 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:14.987164 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:14.987605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:14.988326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:14.989011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:14.989440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:15.143163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:15.151639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-048d2e45-dd11-469a-ab71-19164ad8da2c tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.176722 Aug 24 05:08:15.152217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 514/1013] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:14 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:15.333840 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-25ad2b86-604e-45d5-93e4-366ebecd397b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: .version_select at 0x7fde5e4710d0>, body: {"keypair": {"name": "tempest-keypair-1637687447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDltJiaPUR0Fyu/t64AsJtyFyV2VUyRcFg5B0CSuIh/S2PrbbaWjCIqvlgLTl5Wl9sYrOyO3SbVHLGeNoKga6nCI2NfALunzqoYQI66zqhfDiIwjKceBQmHjnNbkqWvs1g=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:15.356569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-25ad2b86-604e-45d5-93e4-366ebecd397b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:08:15.361156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-25ad2b86-604e-45d5-93e4-366ebecd397b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:08:15.484992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-25ad2b86-604e-45d5-93e4-366ebecd397b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155465 Aug 24 05:08:15.485630 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 500/1014] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:08:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:16.173766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:16.175012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:16.181343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:16.181820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:16.182246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:16.183230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:16.183680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:16.184101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:16.323372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:16.332350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3ceb2e11-47c4-4acb-b4f0-56f56c1c7fb1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.163215 Aug 24 05:08:16.333145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 515/1015] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:16 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:17.354274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:17.362215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:17.362215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:17.362215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:17.362215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:17.362591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:17.362836 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:17.363283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:17.587461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:17.591135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9f53e3a3-a1a0-4ac5-a222-31f9fcc8a457 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.240958 Aug 24 05:08:17.592166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 501/1016] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:17 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:17.736800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1303455113", "imageRef": "8c8c13b0-5fe2-42f5-b814-6fea934015c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2d7953-7d09-41eb-b20e-6de03af460a3"}], "security_groups": [{"name": "tempest-securitygroup--754188419"}], "key_name": "tempest-keypair-1637687447", "user_data": "}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:17.847327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] validate_networks() for [('be2d7953-7d09-41eb-b20e-6de03af460a3', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:08:18.233454 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:08:18.233880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:08:18.234446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:08:18.234893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:08:18.235434 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:08:18.244308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.244790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.245225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.245951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.246455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.246890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.264046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:08:18.268171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Getting quotas for user e45111c49aa74f76874d3a0c747034ba and project fad6d7352bc144929743ca7373a41800. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:08:18.280380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:08:18.282764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c8c13b0-5fe2-42f5-b814-6fea934015c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:08:18.424235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dad597f2-a50e-40f9-917b-3da570168340 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.692295 Aug 24 05:08:18.429134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 516/1017] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:08:17 2022] POST /compute/v2.1/servers => generated 403 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:08:18.439645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9a265843-e5b4-4ae4-a281-c95c055480d5 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:18.440266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9a265843-e5b4-4ae4-a281-c95c055480d5 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:18.527087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9a265843-e5b4-4ae4-a281-c95c055480d5 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:18.527087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9a265843-e5b4-4ae4-a281-c95c055480d5 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1246 microversion: 2.1 time: 0.086810 Aug 24 05:08:18.527087 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 502/1018] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:18 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:18.613899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:18.615187 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:18.628470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.628970 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.629429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.630129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.630589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.631046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.768128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:18.775939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0f76bebd-eaab-4065-8b18-05d2a5253739 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1510 microversion: 2.1 time: 0.166082 Aug 24 05:08:18.776503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 517/1019] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:18 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:18.797927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:18.798522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:18.805031 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.805519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.806259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.806643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:18.807115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:18.807545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:18.839305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122276) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:08:19.183534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6525f7f0-24ec-4595-a307-a04e20dbd98d tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "POST /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882/action" status: 202 len: 0 microversion: 2.1 time: 0.390839 Aug 24 05:08:19.184470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 503/1020] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:08:18 2022] POST /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:08:19.200245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:19.208003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:19.214371 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:19.214868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:19.215340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:19.216047 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:19.217166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:19.217720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:19.354042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:19.381212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-81ee23b0-19ef-43e4-8fe9-f08efd6f6105 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1518 microversion: 2.1 time: 0.191223 Aug 24 05:08:19.396110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 518/1021] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:19 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:19.545404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:19.546753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:19.558329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:19.558329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:19.558329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:19.558329 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:19.558824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:19.558824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:19.637020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:19.641429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:19.646517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fb8e3c0f-4a18-433e-aa0e-c4762eb19813 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1250 microversion: 2.1 time: 0.106314 Aug 24 05:08:19.647211 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 504/1022] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:19 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:20.403733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:20.404444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:20.411983 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:20.412508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:20.413450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:20.414622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:20.415138 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:20.415576 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:20.561344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:20.570794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a9eac828-33a2-428d-a936-1ce4afe30ea0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1518 microversion: 2.1 time: 0.170864 Aug 24 05:08:20.571507 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 519/1023] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:20 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:20.668888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:20.670115 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:20.678053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:20.678591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:20.679105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:20.680044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:20.680501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:20.681102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:20.768032 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:20.779062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8f9e9015-0751-41ac-b209-7d7fed7c3739 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1306 microversion: 2.1 time: 0.114833 Aug 24 05:08:20.779888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 505/1024] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:20 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:21.175753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "name": "network-vif-unplugged", "status": "completed", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:21.190954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:21.198554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:21.198554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:21.211151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.compute.server_external_events [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] Unable to find a host for instance 11f2c50c-6e43-4245-a8a2-b7455d391882. Dropping event network-vif-unplugged {{(pid=122277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 05:08:21.212076 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-7de2dcf9-e6fd-4503-a621-15c83934e886 req-6c059076-2f45-401e-85cf-cdc4e7a480e4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041450 Aug 24 05:08:21.212980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 520/1025] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 05:08:21.593298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:21.593925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:21.601029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:21.601523 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:21.601963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:21.602674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:21.603161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:21.603600 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:21.761292 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:21.771300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-96a523b3-ec1b-4508-80cf-59121a6666f2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1520 microversion: 2.1 time: 0.182177 Aug 24 05:08:21.771880 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 506/1026] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:21 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:21.802357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:21.803236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:21.809962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:21.810539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:21.811062 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:21.812696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:21.813223 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:21.813868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:21.834659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:21.962008 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:21.970391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-db697d9a-2f03-4aa5-bcf5-de7451e547bf tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.171787 Aug 24 05:08:21.971619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 521/1027] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:21 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:22.485793 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7624c5ef-86bd-4c16-a264-57b62be9970c", "tag": "2d4b0199-ca0b-4705-b975-4d9ce0a6650e"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:22.496392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:22.499746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:22.499746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:22.510689 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] Creating event network-changed:2d4b0199-ca0b-4705-b975-4d9ce0a6650e for instance 7624c5ef-86bd-4c16-a264-57b62be9970c on hv-cinder-85426 Aug 24 05:08:22.517412 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-53eaa393-f555-422c-bc5b-44193be11725 req-88ad2a9f-b15c-4e72-b917-6e76767c6c57 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037071 Aug 24 05:08:22.518417 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 507/1028] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:22.802557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:22.803927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:22.812430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:22.813195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:22.813938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:22.814805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:22.815453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:22.816068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:22.966188 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:22.978055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-342d1e13-7e09-49bf-9151-16120c8ef4fa tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.180140 Aug 24 05:08:22.993136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:22.994169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:22.994990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 522/1029] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:22 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:23.000675 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:23.001373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:23.001810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:23.002516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:23.002994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:23.003445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:23.164547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:23.174371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d63a1e46-2c95-47e9-a414-5b2dab7f8fc9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.185468 Aug 24 05:08:23.175350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 508/1030] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:22 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:24.001079 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:24.001843 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:24.009037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:24.009527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:24.009960 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:24.010748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:24.011233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:24.011666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:24.153089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:24.161628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bdd836e7-8e44-4960-a804-0d42e5e4abb0 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.166502 Aug 24 05:08:24.162400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 523/1031] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:23 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:24.195800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:24.196425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:24.202890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:24.203958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:24.204572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:24.205448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:24.206097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:24.206725 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:24.341475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:24.349671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-04761b7c-47fc-4ba6-a035-16c4b57a4044 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.158400 Aug 24 05:08:24.353683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 509/1032] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:24 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:25.185196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:25.185987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:25.193290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:25.193767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:25.194197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:25.194896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:25.195418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:25.195907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:25.379925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:25.381080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:25.395196 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:25.395909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:25.396626 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:25.397847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:25.398629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:25.399377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:25.674398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:25.685575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e5826baa-0140-4b02-b988-d5b3b31a87a2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.505324 Aug 24 05:08:25.686370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 524/1033] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:25 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:25.723296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:25.731109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a247fd03-98e1-49e9-b242-ee23c6413828 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.360239 Aug 24 05:08:25.731692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 510/1034] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:25 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:26.713586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:26.714899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:26.722984 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:26.723688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:26.724340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:26.725526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:26.726366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:26.727109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:26.756837 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:26.757952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:26.769546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:26.770490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:26.771344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:26.773028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:26.774022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:26.774945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:26.983329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:26.986140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:26.993557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-104f3c52-8d3c-47be-952c-71878140f3c1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.285586 Aug 24 05:08:26.994142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 525/1035] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:26 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:27.006449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e5376cf2-cadc-4cad-ad33-9f991f05d3f1 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.245265 Aug 24 05:08:27.007784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 511/1036] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:26 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:28.019687 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:28.026509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:28.026509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:28.027884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:28.028370 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:28.028814 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:28.029318 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:28.029862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:28.030336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:28.030540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:28.031012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:28.037896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:28.038386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:28.038861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:28.039598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:28.040048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:28.040470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:28.252327 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:28.255350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:28.267999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ebf72a34-5223-4b4a-b3cd-84249187dd43 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.252607 Aug 24 05:08:28.267999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 526/1037] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:28 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:28.268544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:28.280049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d08563e0-3431-46e6-babf-e65d318ce6db tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.254443 Aug 24 05:08:28.281427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 512/1038] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:28 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:29.290003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:29.290620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:29.292815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:29.299735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:29.300227 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:29.300669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:29.301376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:29.301837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:29.302265 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:29.303989 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:29.304601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:29.307909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:29.320083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:29.320646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:29.321119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:29.322037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:29.322639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:29.323092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:29.528928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:29.537895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f6ccc5d0-905c-4970-8ad8-b2bf5a676460 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.253505 Aug 24 05:08:29.538093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:29.538479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 527/1039] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:29 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:29.547483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5290e9fd-994b-4e21-bb3e-fb8c8c2db795 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.247499 Aug 24 05:08:29.548815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 513/1040] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:29 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:30.561685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:30.562368 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:30.568517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:30.569124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:30.569459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:30.570141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:30.570890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:30.572124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:30.572787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:30.573788 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:30.576524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:30.576942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:30.577416 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:30.578128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:30.578577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:30.578996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:30.790902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:30.801243 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c87742fb-5423-454d-963d-3a3c9cff4e15 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.243749 Aug 24 05:08:30.801836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 528/1041] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:30 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:30.805854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:30.814369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6110a153-ef88-4967-8cb5-102309143763 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.249384 Aug 24 05:08:30.814870 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 514/1042] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:30 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:31.419270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7624c5ef-86bd-4c16-a264-57b62be9970c", "name": "network-vif-plugged", "status": "completed", "tag": "2d4b0199-ca0b-4705-b975-4d9ce0a6650e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:31.429966 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:31.430456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:31.430914 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:31.443755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] Creating event network-vif-plugged:2d4b0199-ca0b-4705-b975-4d9ce0a6650e for instance 7624c5ef-86bd-4c16-a264-57b62be9970c on hv-cinder-85426 Aug 24 05:08:31.450028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-0ebe4904-9b6d-40dc-a279-011722f607a4 req-9dc958f3-7308-4795-8e60-b22b109705ed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034422 Aug 24 05:08:31.451092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 529/1043] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:31.822878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:31.823488 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:31.830612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:31.831431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:31.831868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:31.832581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:31.833065 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:31.833741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:31.837268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:31.837995 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:31.845335 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:31.845846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:31.846286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:31.847110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:31.847641 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:31.848021 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:32.107273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:32.115064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:32.119922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8e74ee59-af42-48d9-8fe0-24beb0e9a795 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.300545 Aug 24 05:08:32.121051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 515/1044] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:31 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:32.127768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-10363245-f399-464a-b41c-8882fc6eb163 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.295158 Aug 24 05:08:32.128554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 530/1045] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:31 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:33.146233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:33.147084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:33.153667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:33.154230 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:33.154828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:33.155387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:33.155767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:33.157033 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:33.157424 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:33.158020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:33.162801 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:33.163693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:33.164455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:33.165262 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:33.165948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:33.166403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:33.387980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:33.391450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:33.396531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-62d6cc76-dc9e-48ff-8862-a706febf8e7b tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.253888 Aug 24 05:08:33.397027 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 516/1046] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:33 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:33.408098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-cabcd50c-51fe-4022-968d-0ad8247dd2f4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1371 microversion: 2.1 time: 0.258349 Aug 24 05:08:33.408951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 531/1047] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:33 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:34.417981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:34.418597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:34.426618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.427158 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.427592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.428294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.428781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.429202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.437142 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:34.437963 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:34.444614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.445027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.445469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.446178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.446630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.447151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.646426 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:34.651662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:34.655162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-364c03bf-291e-4162-9f1a-5d256b1fb9d2 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.241191 Aug 24 05:08:34.658382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 517/1048] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:34 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:34.662065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dcc4c1d1-402e-462b-9847-95d1fad3597c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1560 microversion: 2.1 time: 0.229190 Aug 24 05:08:34.662646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 532/1049] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:34 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:34.683323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:34.683809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:34.690798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.691495 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.695300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.695300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.695300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.695300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.778172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fa540d9f-8367-4976-aeea-8facc38e0553 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098823 Aug 24 05:08:34.778769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 518/1050] 10.222.0.105 () {58 vars in 1280 bytes} [Wed Aug 24 05:08:34 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:35.333426 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "name": "network-vif-plugged", "status": "completed", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:35.344089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.344757 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.345261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.357613 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] Creating event network-vif-plugged:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:08:35.362904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-b14f7c97-6773-4089-8ed7-57dadeed3753 req-5d9b7860-87db-437b-bd20-b3e1d85a455d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Aug 24 05:08:35.363536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 533/1051] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:35.678359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:35.679007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:35.689411 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.690225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.690861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.691994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.693068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.693833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.953414 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:35.982805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3a1100e7-5eff-46e5-8774-0fe3d91c6e3f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.308378 Aug 24 05:08:35.983252 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 519/1052] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:35 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:36.040385 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7624c5ef-86bd-4c16-a264-57b62be9970c", "tag": "2d4b0199-ca0b-4705-b975-4d9ce0a6650e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:36.052295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.053143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.053786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.069738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] Creating event network-changed:2d4b0199-ca0b-4705-b975-4d9ce0a6650e for instance 7624c5ef-86bd-4c16-a264-57b62be9970c on hv-cinder-85426 Aug 24 05:08:36.075540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-32813454-d79f-40f8-b6c4-9d12a311f1cb req-d12c8a9a-09c1-4f99-953e-cb08c2100827 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039910 Aug 24 05:08:36.075954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 534/1053] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:37.005236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:37.006370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:37.008856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:37.015833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:37.016222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:37.017005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:37.017802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:37.018272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:37.018704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:37.197659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:37.207712 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-84cd6cb1-1044-4a87-9791-abfbe80bb675 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1576 microversion: 2.1 time: 0.206564 Aug 24 05:08:37.208303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 520/1054] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:36 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:38.231006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:38.231800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:38.238339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:38.238833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:38.239291 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:38.239999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:38.242458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:38.242458 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:38.387344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:38.396241 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c0e47617-c19d-43a5-82d1-b952197cf92f tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1563 microversion: 2.1 time: 0.169923 Aug 24 05:08:38.396813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 535/1055] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:08:38 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:41.690529 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:41.691556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:41.700585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:41.701078 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:41.701519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:41.702281 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:41.702792 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:41.703429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:41.745455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-04d962e6-29b0-4933-b9ec-e6a7cd1338d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/ips" status: 200 len: 152 microversion: 2.20 time: 0.062510 Aug 24 05:08:41.746051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 521/1056] 10.222.0.105 () {60 vars in 1294 bytes} [Wed Aug 24 05:08:41 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:08:45.082683 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:45.083369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:45.090131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:45.090607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:45.091056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:45.091749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:45.092315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:45.092733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:45.115756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lazy-loading 'flavor' on Instance uuid 7559b8f3-b3b1-435b-9463-68acef1ab41e {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:08:45.648951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5d819b84-548a-437e-a0c4-0eeab072175e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/action" status: 202 len: 0 microversion: 2.20 time: 0.571498 Aug 24 05:08:45.649625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 536/1057] 10.222.0.105 () {62 vars in 1324 bytes} [Wed Aug 24 05:08:45 2022] POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:08:45.658896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:45.659760 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:45.666238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:45.672701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:45.672701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:45.672701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:45.672701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:45.673787 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:45.805745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:45.809260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:45.815131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:45.816710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:45.817896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-09084887-0754-48a8-84ac-32088e6c9607 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.163833 Aug 24 05:08:45.818459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 522/1058] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:45 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:46.844130 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:46.845490 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:46.851740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:46.852257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:46.852693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:46.853388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:46.853845 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:46.854268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:46.989886 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:46.998053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:46.999564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:47.000713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0b66d17e-72db-4a18-8fdd-8309f9bf4d5b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.161411 Aug 24 05:08:47.002040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 537/1059] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:46 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:48.024452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:48.025129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:48.032280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:48.032813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:48.033306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:48.034010 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:48.034467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:48.034894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:48.392763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:48.402289 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:48.403978 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:48.405176 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4c4f0fb8-f0f3-4bed-97d2-77deffcda1db tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.384691 Aug 24 05:08:48.405748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 523/1060] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:48 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:08:49.428879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:49.429560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:49.436380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:49.436854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:49.437283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:49.437973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:49.438924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:49.439791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:49.444206 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:49.585717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:49.593903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:49.595505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:49.596668 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7cf69deb-a9df-4805-9dad-248709addfc5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.171726 Aug 24 05:08:49.597234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 538/1061] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:49 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:08:50.620000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:50.620592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:50.628575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:50.629085 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:50.629517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:50.630210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:50.630659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:50.631102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:50.769193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:50.777505 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:50.778999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:50.780184 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-41e80702-a34c-4397-aa00-1294a4a19517 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.164417 Aug 24 05:08:50.780743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 524/1062] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:50 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:51.804440 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:51.805054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:51.811924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:51.812403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:51.812832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:51.813533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:51.813981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:51.814406 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:51.954849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:51.963669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:51.965174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:51.966339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fcb8f47a-3bc8-4d40-88c3-404e22d622de tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.165946 Aug 24 05:08:51.966902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 539/1063] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:51 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:08:52.989640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:52.990372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:52.997119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:52.997609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:52.998057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:52.998847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:52.999351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:52.999782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:53.152572 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:53.165676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:53.168104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:53.169322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-03ae1b3c-18fb-44d8-a6f2-1f742ced667d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.184340 Aug 24 05:08:53.170127 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 525/1064] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:52 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:54.193994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:54.194755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:54.201842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:54.202320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:54.202750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:54.203482 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:54.203934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:54.204436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:54.352900 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:54.366196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:54.367987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:54.369367 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-99e86d5c-2779-4684-8ac7-3ab5195f4c6e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.179594 Aug 24 05:08:54.370012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 540/1065] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:54 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:55.393610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:55.394182 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:55.400670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:55.401152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:55.401581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:55.402430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:55.402815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:55.403284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:55.542449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:55.552774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:55.554262 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:55.555455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-6a451bec-ad6f-4ae8-8fe6-d2bc58d9076f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.166126 Aug 24 05:08:55.556015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 526/1066] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:55 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:56.578780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:56.579479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:56.586460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:56.586952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:56.587420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:56.588126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:56.588597 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:56.589055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:56.718657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:56.735626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:56.735626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:56.735626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9560e927-e43d-4128-9336-8855c26e8d09 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.156791 Aug 24 05:08:56.735924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 541/1067] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:56 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:57.758452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:57.759092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:57.765566 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:57.766050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:57.766484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:57.767228 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:57.768347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:57.768872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:57.905415 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:57.913751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:57.915322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:57.927886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-33d02590-26be-4c35-aa5f-821f6087164d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.162087 Aug 24 05:08:57.927886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 527/1068] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:57 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:08:58.942981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:58.943552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:58.946015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=32 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:58.951134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:58.951661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:58.952102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:58.952831 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:58.953294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:58.953725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:59.085067 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:59.093987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:59.095571 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:59.096760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a594bb31-0218-4bf8-bae0-900eaf0af234 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.158432 Aug 24 05:08:59.097344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 542/1069] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:08:58 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:00.119560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:00.120532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:00.127346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:00.127844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:00.128285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:00.128970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:00.129599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:00.130168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:00.268562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:00.277259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:00.278758 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:00.279954 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5c617c5c-bf34-4a9f-a814-0dc8c9e1ce34 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.164868 Aug 24 05:09:00.280515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 528/1070] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:00 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:01.304149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:01.304795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:01.311381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.311863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.312304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.313013 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.313473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.313901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.446287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:01.454518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:01.456098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:01.457268 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e6cdd955-945a-4ef7-bbc3-f08264049bed tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.157570 Aug 24 05:09:01.457833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 543/1071] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:01 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:02.480573 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:02.481164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:02.487522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:02.488004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:02.488434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:02.489132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:02.489580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:02.490003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:02.623374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:02.632403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:02.633923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:02.635163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c639d291-6059-4f03-8789-8bc640a66ff3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.158572 Aug 24 05:09:02.636066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 529/1072] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:02 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:03.659381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:03.659994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:03.666982 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:03.668689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:03.668689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:03.668885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:03.669207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:03.669636 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:03.810460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:03.819110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:03.820622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:03.821936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a22b0a39-a0ac-4b90-add9-c2c1b70970d4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.166702 Aug 24 05:09:03.822513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 544/1073] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:03 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:04.847595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:04.848214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:04.855769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:04.856693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:04.856693 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:04.857437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:04.857897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:04.858325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:05.000799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:05.010444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:05.011951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:05.013202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4f9d4522-219a-44b1-9733-4be0870f5dc4 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.169655 Aug 24 05:09:05.013754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 530/1074] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:04 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:06.040600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:06.041305 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:06.050259 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:06.050758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:06.051264 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:06.051978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:06.052578 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:06.053016 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:06.216027 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:06.225457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:06.228390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:06.229990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f60050ef-ae69-41ab-bd7e-76c92dfcbf19 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.195568 Aug 24 05:09:06.230546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 545/1075] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:06 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:07.259830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:07.260437 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:07.267702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:07.268187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:07.268625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:07.269354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:07.269809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:07.270267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:07.405199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:07.413664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:07.415183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:07.416357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-01d114a8-efce-4c79-9e09-fcc0d17eb4ff tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.160567 Aug 24 05:09:07.416928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 531/1076] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:07 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:08.441882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:08.442422 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:08.448619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:08.449251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:08.449689 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:08.450400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:08.451410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:08.451836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:08.587115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:08.596384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:08.597872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:08.601338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b2e6c783-4b1e-4827-b6f4-84d176cc9e23 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.161105 Aug 24 05:09:08.601338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 546/1077] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:08 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:09.469404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "name": "network-vif-plugged", "status": "completed", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:09.479603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:09.480153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:09.480581 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:09.492526 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] Creating event network-vif-plugged:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:09:09.497612 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-3e4fb166-b2ad-43aa-948d-678c3bff46ab req-97cbcad1-7cb4-496b-9087-01ce942f5e05 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Aug 24 05:09:09.498306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 532/1078] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:09.622409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:09.623040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:09.629935 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:09.634499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:09.634499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:09.634499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:09.634499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:09.634941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:09.772004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:09.781811 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:09.783797 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:09.785092 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9d103370-b952-46fb-af8c-678dd75563b3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.166815 Aug 24 05:09:09.785643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 547/1079] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:09 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:10.811920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:10.812623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:10.818993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:10.819527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:10.819965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:10.820664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:10.821126 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:10.821554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:10.961215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:10.970546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:10.972080 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:10.973331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-152e55c4-26e4-43ec-a540-c3857f7d9751 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.166149 Aug 24 05:09:10.974319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 533/1080] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:10 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:11.995688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:11.996418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:12.003627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:12.004108 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:12.004542 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:12.005242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:12.005699 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:12.006125 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:12.145126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:12.153647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:12.156089 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:12.156939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7490024a-bf82-4156-b76a-d847e8408b55 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.165215 Aug 24 05:09:12.157495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 548/1081] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:11 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:13.182343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:13.182944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:13.185489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=28 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:13.192548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:13.193478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:13.193478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:13.194152 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:13.194601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:13.195143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:13.348373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:13.357476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:13.358983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:13.361195 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5033caf8-bc76-4ef0-aa20-ab0f63f19c0b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1748 microversion: 2.20 time: 0.183269 Aug 24 05:09:13.361957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 534/1082] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:13 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:14.386040 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:14.387338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:14.394511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:14.396038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:14.396038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:14.396339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:14.396669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:14.397099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:14.591594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:14.622082 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:14.623631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:14.624966 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-72fe6aff-9506-4c2f-af01-6ec76b071fa1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.242828 Aug 24 05:09:14.625535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 549/1083] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:14 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:15.651368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:15.652024 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:15.663366 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:15.664310 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:15.665037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:15.666254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:15.666923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:15.671601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:15.871719 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:15.880618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:15.882222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:15.883645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4122a948-790f-4c4b-9840-044c96fdb3e0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.236427 Aug 24 05:09:15.884598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 535/1084] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:15 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:16.908794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:16.909362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:16.920266 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:16.922167 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:16.922819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:16.924560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:16.925382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:16.927394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:17.137513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:17.148351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:17.152857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:17.154618 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-28f9dc73-2573-42d4-8364-47af699ae34f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.250716 Aug 24 05:09:17.165568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 550/1085] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:16 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:18.184280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:18.185478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:18.193839 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:18.194511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:18.198265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:18.199352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:18.199988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:18.200604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:18.204616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=75 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:18.385022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:18.394325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:18.395982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:18.397256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-314bdf64-21fd-4da0-a180-d15dd4f30344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.217026 Aug 24 05:09:18.411059 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 536/1086] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:18 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:19.435953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:19.436673 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:19.446247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:19.447479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:19.448005 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:19.448804 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:19.449942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:19.450452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:20.214619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:20.216940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=81 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:20.225388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:20.227974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:20.229651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b18ec875-e90c-47e7-a45b-2b1d235d555e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.798479 Aug 24 05:09:20.242506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 551/1087] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:19 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:21.258514 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:21.259747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:21.269598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:21.273062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:21.274284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:21.282352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:21.283422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:21.284060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:21.671707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:21.702500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:21.704718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:21.707404 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2e1f178d-8561-4963-a4c4-fad69be03344 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.453396 Aug 24 05:09:21.719455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 537/1088] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:21 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:22.740525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:22.741944 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:22.764361 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:22.766676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:22.767495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:22.775324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:22.779874 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:22.782500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:23.109778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:23.109778 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:23.115322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:23.117425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7db84327-90ff-4fd2-8af4-3f18796c10aa tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.382554 Aug 24 05:09:23.132871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 552/1089] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:22 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:24.150286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:24.152876 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:24.162271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:24.163629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:24.164798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:24.166113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:24.166595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:24.167056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:24.481997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:24.502702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:24.515006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:24.523471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-adc2b382-89be-4a6c-81af-2c6e3fccdf42 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.371681 Aug 24 05:09:24.528114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 538/1090] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:24 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:25.557023 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:25.557616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:25.566060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:25.566785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:25.567260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:25.568006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:25.568455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:25.569051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:25.771003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:25.783139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:25.784664 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:25.785921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ff96e860-6088-4749-890a-9265f6905fbf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.236751 Aug 24 05:09:25.799749 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 553/1091] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:25 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:26.822510 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:26.823429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:26.852112 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:26.852768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:26.853465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:26.854400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:26.855006 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:26.855646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:27.092189 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:27.108459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:27.110130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:27.112043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-95ea9273-d565-4fd7-a790-ead84e45a90a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.305762 Aug 24 05:09:27.128775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 539/1092] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:26 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:28.138400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:28.139046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:28.146128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:28.146631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:28.147098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:28.147877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:28.148338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:28.148766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:28.290144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:28.299629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:28.301135 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:28.302425 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7e3231ca-27aa-4422-a0b9-7d037e10b2c9 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.168424 Aug 24 05:09:28.311496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 554/1093] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:28 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:29.331067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:29.331780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:29.349578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:29.360986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:29.362345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:29.364462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:29.365242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:29.365740 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:29.553245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:29.565640 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:29.567766 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:29.572547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2229d5ea-be32-4d94-b951-97db6263400d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.247309 Aug 24 05:09:29.572547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 540/1094] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:29 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:30.594906 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:30.596325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:30.599134 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=26 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:30.604258 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:30.605081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:30.605739 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:30.612753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:30.612753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:30.612753 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:30.774230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:30.792657 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:30.801086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:30.802800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8cd9d1e0-91a8-4e97-b3f9-3cdb0c8381d1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1743 microversion: 2.20 time: 0.212696 Aug 24 05:09:30.822860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 555/1095] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:30 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:31.443550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:31.444983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:31.462105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:31.462605 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:31.463065 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:31.463785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:31.464246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:31.464671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:31.502961 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4426e836-2e6f-4eba-abdb-bd616f6ff266 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/ips" status: 200 len: 146 microversion: 2.1 time: 0.063202 Aug 24 05:09:31.510601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 541/1096] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:09:31 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/ips => generated 146 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:31.835277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:31.835896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:31.846862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:31.847803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:31.848252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:31.849246 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:31.849822 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:31.850306 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:32.026101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:32.037045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:32.039267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:32.055183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0b1e7c33-f03f-4489-bb7a-d5b4495b6c5f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1725 microversion: 2.20 time: 0.214064 Aug 24 05:09:32.055183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 556/1097] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:31 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:33.067347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:33.068645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:33.075334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:33.076810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:33.077250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:33.077968 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:33.078525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:33.079559 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:33.237374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:33.247824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:33.249389 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:33.250622 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-340270d8-2e11-4871-b4ce-97ae2e5b7a65 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1725 microversion: 2.20 time: 0.188337 Aug 24 05:09:33.265450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 542/1098] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:33 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:33.577487 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "name": "network-vif-unplugged", "status": "completed", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:33.589284 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:33.590564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:33.591101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:33.604905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] Creating event network-vif-unplugged:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:09:33.612158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-30917f2e-1735-4e6b-8c31-6a7971d9f95e req-cc7d5cc0-9e2d-42b7-b51c-dcfc92e2a69a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039157 Aug 24 05:09:33.613002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 557/1099] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:09:34.277788 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:34.278399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:34.301217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.301704 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.302140 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:34.302854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.303923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.304362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:34.472543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:34.481987 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:34.485473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:34.486721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-93ee6bf2-9b9a-4961-ba46-b961d0073a40 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1728 microversion: 2.20 time: 0.217104 Aug 24 05:09:34.489940 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 543/1100] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:34 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:34.517016 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "241ad643-d1a0-4b4e-ae1c-d414c60c795e"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:34.520137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:34.526981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.527667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.528200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:34.528889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.529349 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.529774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:34.628679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a9fc03-8a86-4e49-aaca-135fde9404be"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:34.631517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:34.640672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.642166 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.642876 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:34.643815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:34.644441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:34.645085 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:35.925093 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cd4264e9-c053-4f98-9a6f-8859ab36505d tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.300868 Aug 24 05:09:35.925917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 544/1101] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:09:34 2022] POST /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 194 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:36.341889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac142721-f3d6-4756-8e57-4ffe30e87142 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.830425 Aug 24 05:09:36.344671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 558/1102] 10.222.0.105 () {62 vars in 1369 bytes} [Wed Aug 24 05:09:34 2022] POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments => generated 188 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:09:36.487147 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:36.487991 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:36.497591 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:36.498100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:36.498512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:36.499461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:36.500077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:36.501205 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:37.130002 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-200b8171-5b4c-4f32-83b8-dd1d1074a68b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments/241ad643-d1a0-4b4e-ae1c-d414c60c795e" status: 202 len: 0 microversion: 2.20 time: 0.648433 Aug 24 05:09:37.133003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 545/1103] 10.222.0.105 () {60 vars in 1462 bytes} [Wed Aug 24 05:09:36 2022] DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments/241ad643-d1a0-4b4e-ae1c-d414c60c795e => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:09:37.203278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:37.204857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:37.212037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:37.212593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:37.215313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:37.215313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:37.215313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:37.215313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:37.269993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122277) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:09:37.587756 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d8c7f705-2c3e-41ff-a860-a56279579632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/action" status: 202 len: 0 microversion: 2.20 time: 0.389087 Aug 24 05:09:37.591565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 559/1104] 10.222.0.105 () {62 vars in 1324 bytes} [Wed Aug 24 05:09:37 2022] POST /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:09:37.597375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:37.598258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:37.605484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:37.607748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:37.607748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:37.607748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:37.608383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:37.609020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:38.014970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:38.024723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:38.026247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:38.027523 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c2183d2d-210c-47d6-8d13-8c6e847c973a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1676 microversion: 2.20 time: 0.434769 Aug 24 05:09:38.028143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 546/1105] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:37 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1676 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:39.052272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:39.053086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:39.059295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:39.059793 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:39.060233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:39.060947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:39.061590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:39.062177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:39.218522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:39.241161 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:39.243151 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:39.244918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-69ec436a-3c6b-4055-9d06-717558cbf3fd tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1676 microversion: 2.20 time: 0.197072 Aug 24 05:09:39.245776 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 560/1106] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:39 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:39.758263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-038b6217-31e3-4ecd-a39f-4da1e256ce68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'create', calling method: .version_select at 0x7fde5e476160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1611935646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUO9ag98a0j8RMfcW9/7tKRjDOd+YqOROpwMVfbmXpkj6sxH1Ud1bkYOTLDdp82GuhamRainQ1sDDJtCq16PcPxDsB5n4jooClP/UqCCpnwBoR+mYRxjZ9quD7+ufl71g=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:39.774226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-038b6217-31e3-4ecd-a39f-4da1e256ce68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Getting quotas for project 67112706d4df4183bc338732b237df6e. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:09:39.778108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-038b6217-31e3-4ecd-a39f-4da1e256ce68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Getting quotas for user dfc1475f560d4151a0c569433544f36a and project 67112706d4df4183bc338732b237df6e. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:09:39.875887 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-038b6217-31e3-4ecd-a39f-4da1e256ce68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.121003 Aug 24 05:09:39.876538 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 547/1107] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:09:39 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:09:39.932543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-267031034", "imageRef": "a28edd30-ab3c-4810-a27d-2112f40ba73d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1611935646", "networks": [{"uuid": "1797f5d6-f35a-403a-9635-a2f993ac8d6b"}]}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:39.987175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.network.neutron [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] validate_networks() for [('1797f5d6-f35a-403a-9635-a2f993ac8d6b', None, None, None, None, None)] {{(pid=122277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:09:40.269238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:40.270148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:40.276837 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:40.277578 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:40.278258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:40.279223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:40.279868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:40.280480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:40.457525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Flavor limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:09:40.458042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Image limits 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:09:40.458419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Flavor pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:09:40.458974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Image pref 0:0:0 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:09:40.459428 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.virt.hardware [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:09:40.471099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:40.471815 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:40.472264 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:40.473010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:40.473476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:40.473939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:40.487849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:40.496263 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:40.497801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:40.498990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-38f1859d-a6c9-49b0-810d-e7023c488632 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.233918 Aug 24 05:09:40.499590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 548/1108] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:40 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:40.500011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Getting quotas for project 67112706d4df4183bc338732b237df6e. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:09:40.505470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.quota [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Getting quotas for user dfc1475f560d4151a0c569433544f36a and project 67112706d4df4183bc338732b237df6e. Resources: {'cores', 'ram', 'instances'} {{(pid=122277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:09:40.518120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Going to run 1 instances... {{(pid=122277) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:09:40.520377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a28edd30-ab3c-4810-a27d-2112f40ba73d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:09:40.653591 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-99826b3a-5843-4e82-87f1-ab4216f063ec tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.724899 Aug 24 05:09:40.654453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 561/1109] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:09:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:09:40.665613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0205a10b-3b86-4df3-9c35-aa28890e24b8 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:40.666236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0205a10b-3b86-4df3-9c35-aa28890e24b8 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:40.726958 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0205a10b-3b86-4df3-9c35-aa28890e24b8 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:40.733917 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0205a10b-3b86-4df3-9c35-aa28890e24b8 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1262 microversion: 2.1 time: 0.072223 Aug 24 05:09:40.735342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 549/1110] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:40 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:41.524336 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:41.525558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:41.534833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:41.535379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:41.537137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:41.537137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:41.537137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:41.537600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:41.702612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:41.712292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:41.714120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:41.715607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-eafa4be9-601b-409a-aa4e-e18a25c34878 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.196852 Aug 24 05:09:41.716166 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 562/1111] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:41 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:41.756440 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:41.757772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:41.765517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:41.767379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:41.767711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:41.768378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:41.768847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:41.769278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:41.837311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:41.845328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-31f71af6-5790-47c4-97d6-d3b9734b689c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.093235 Aug 24 05:09:41.845826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 550/1112] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:41 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:42.742066 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:42.742589 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:42.750179 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:42.750725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:42.751183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:42.751901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:42.752387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:42.752813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:42.866311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:42.866962 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:42.874273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:42.874762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:42.875816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:42.876842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:42.877462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:42.878030 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:42.901204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:42.912748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:42.921285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:42.923530 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:42.925043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f7592658-be1d-41b2-b62e-f7722d1f31bf tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.186963 Aug 24 05:09:42.925617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 563/1113] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:42 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:42.945555 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:42.955633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a22f851e-50e7-4aa4-bba8-941ddd5b15a3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.093324 Aug 24 05:09:42.956661 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 551/1114] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:42 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:09:43.949136 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:43.949733 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:43.957626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.958109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.958535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:43.959472 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.959926 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.960350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:43.976971 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:43.977546 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:43.980201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:43.985394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.985977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.986448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:43.987261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.987754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.993014 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:44.071801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:44.081272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9cd5ef90-e068-422a-97c5-af151e637416 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.108443 Aug 24 05:09:44.107198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 552/1115] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:43 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:09:44.147803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:44.158732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:44.160539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:44.161752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-94e68a78-461c-4c54-9660-7a852a4ccdd8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.216646 Aug 24 05:09:44.162313 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 564/1116] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:43 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:45.102644 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:45.103684 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:45.110545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:45.111064 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:45.111501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:45.112212 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:45.112670 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:45.113092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:45.187191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:45.190082 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:45.202790 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:45.203351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:45.203894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:45.204731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:45.205301 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:45.205816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:45.223751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:45.239214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-68d13a79-b720-4e25-99e9-d71f74207606 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.140497 Aug 24 05:09:45.240274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 553/1117] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:45 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:45.415810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:45.425780 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:45.427293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:45.428476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f02ce9ce-d49c-4811-b954-a62a3eb12eb8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.246805 Aug 24 05:09:45.429038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 565/1118] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:45 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:46.262244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:46.263920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:46.271656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:46.272144 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:46.272664 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:46.273412 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:46.273939 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:46.274362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:46.342302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:46.350646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-92179392-a700-4c35-97d5-0b01773188e0 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.092551 Aug 24 05:09:46.351269 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 554/1119] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:46 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:46.456537 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:46.457626 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:46.466728 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:46.467964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:46.468567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:46.469764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:46.470333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:46.470909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:46.474165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:46.633353 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:46.642770 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:46.644726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:46.646060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2da2af44-3d33-4cbb-b24a-13d356772615 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.195452 Aug 24 05:09:46.647001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 566/1120] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:46 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:47.371859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:47.373143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:47.381731 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:47.382217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:47.382651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:47.383445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:47.384095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:47.384519 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:47.460928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:47.471256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-629787cb-dedf-4dec-8d5d-3c7c470f739b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.103758 Aug 24 05:09:47.471845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 555/1121] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:47 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:47.673133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:47.674643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:47.682010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:47.682722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:47.682940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:47.683695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:47.684180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:47.684554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:47.873429 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:47.883606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:47.885686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:47.887114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7a6287cc-9372-49c1-9401-1f1aca632e47 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.219756 Aug 24 05:09:47.888127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 567/1122] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:47 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:48.493583 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:48.494243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:48.501531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:48.502351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:48.502885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:48.503723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:48.504275 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:48.504799 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:48.582238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:48.590343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-14d3151c-7f23-4aa5-8288-5477ba8ea311 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.100710 Aug 24 05:09:48.591508 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 556/1123] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:48 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:48.911765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:48.912389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:48.919177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:48.919666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:48.920096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:48.920820 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:48.921257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:48.921680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:49.075496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:49.085529 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:49.096344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:49.096344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f808872a-005a-4e7a-af98-824c32449a53 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.180943 Aug 24 05:09:49.096344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 568/1124] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:48 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:49.612279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:49.616700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:49.620355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:49.620848 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:49.621348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:49.621996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:49.622448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:49.622869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:49.693757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:49.704625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5a12f1c1-65e2-434b-a60a-adeab84e3e9d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.096346 Aug 24 05:09:49.707520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 557/1125] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:49 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:50.114738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:50.115390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:50.122269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:50.122750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:50.123233 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:50.123943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:50.124389 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:50.124817 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:50.261918 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:50.271730 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:50.273653 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:50.274721 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ff26bfcd-94cc-4865-8974-ab5d4ed3647d tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.164792 Aug 24 05:09:50.275400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 569/1126] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:50 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:50.725633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:50.726258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:50.731754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:50.733512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:50.733988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:50.734417 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:50.735244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:50.735709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:50.736130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:50.806476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:50.815477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-288d441c-1b21-4ba3-b75b-42ee41e29d03 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.093632 Aug 24 05:09:50.823217 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 558/1127] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:50 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:51.299587 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:51.300244 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:51.302056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:51.302732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:51.308229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:51.308748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:51.309190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:51.309899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:51.310358 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:51.310786 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:51.442729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:51.450836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:51.452358 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:51.453505 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e973db6c-8a6a-459b-af59-05d29ffb0ec1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.158916 Aug 24 05:09:51.454294 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 570/1128] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:51 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:51.836345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:51.836932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:51.843527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:51.844003 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:51.844435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:51.845474 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:51.845977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:51.846350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:51.907765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:51.915667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b6ac7d8d-f692-4637-9f06-9452d04331f3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.083213 Aug 24 05:09:51.916238 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 559/1129] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:51 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:52.476968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:52.477495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:52.484417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:52.484890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:52.485377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:52.486239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:52.486698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:52.487155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:52.627891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:52.636070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:52.637655 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:52.638821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b87474c8-ae41-4f8c-ac4d-ab8d9e268f29 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.165924 Aug 24 05:09:52.639633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 571/1130] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:52 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:52.940151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:52.941141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:52.950601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:52.951124 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:52.951588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:52.952288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:52.952738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:52.953160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:53.022312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:53.030730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2b1e8db1-800c-4fb4-8e12-d639840c0974 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.096447 Aug 24 05:09:53.031357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 560/1131] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:52 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:53.663665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:53.664264 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:53.670991 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:53.671491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:53.671923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:53.672610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:53.673713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:53.674391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:53.815882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:53.824191 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:53.825681 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:53.826859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-35409b3d-c728-411c-9823-ce5afed7e0e1 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.167256 Aug 24 05:09:53.827446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 572/1132] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:53 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:09:54.055328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:54.055942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:54.063250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:54.064284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:54.064776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:54.065518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:54.065977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:54.066403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:54.132501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:54.140408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d83b6d87-4b56-47e1-9389-c012b26a01b7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1266 microversion: 2.1 time: 0.091328 Aug 24 05:09:54.140985 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 561/1133] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:54 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:09:54.851409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:54.852033 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:54.858536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:54.859010 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:54.859467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:54.860149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:54.860602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:54.861021 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:54.992812 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:55.001086 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:55.003478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:55.004709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fc263a1f-c41f-4e13-9f70-a0b0fe76cf7e tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.157271 Aug 24 05:09:55.005282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 573/1134] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:54 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:55.162089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:55.162617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:55.171008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:55.171592 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:55.172044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:55.172885 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:55.173407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:55.173852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:55.246137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:55.254696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8aba8604-d4da-46d1-9a2d-2b9d58b98abb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1258 microversion: 2.1 time: 0.096734 Aug 24 05:09:55.256342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 562/1135] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:55 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:56.027199 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:56.027745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:56.034469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:56.034947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:56.035513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:56.036221 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:56.036672 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:56.037101 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:56.172674 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:56.183120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:56.184624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:56.185793 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d38b64a9-3ca5-44fb-884b-bf234a20f2d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.162624 Aug 24 05:09:56.186356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 574/1136] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:56 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:56.276060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:56.276681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:56.283336 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:56.283785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:56.284232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:56.284952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:56.285417 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:56.285847 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:56.354905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:56.363411 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-9c1ac688-bcb2-47b3-b929-f89cc1edc6c3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1258 microversion: 2.1 time: 0.091160 Aug 24 05:09:56.363996 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 563/1137] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:56 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:57.209531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:57.210141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:57.216795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:57.217280 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:57.217726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:57.218437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:57.219316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:57.219472 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:57.368437 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:57.379616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:57.382476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:57.384347 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f314720d-f4c6-446d-bfbd-3a2cd20eeea6 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.178623 Aug 24 05:09:57.385129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 575/1138] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:57 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:57.387249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:57.388241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:57.395192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:57.395676 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:57.396121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:57.396862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:57.397299 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:57.398173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:57.466272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:57.475090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4c6c1110-baa7-4aa1-8dd2-467c758c421b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1314 microversion: 2.1 time: 0.093197 Aug 24 05:09:57.475695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 564/1139] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:57 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1314 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:58.409394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:58.413317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:58.418115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.418593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.419274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.420030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.420493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.420933 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.501164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:58.505574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:58.515384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.516842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.518121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.519706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.520439 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.521097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.614565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:58.626602 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cd5c99ca-3753-4923-abee-74ef7a538861 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1320 microversion: 2.1 time: 0.133452 Aug 24 05:09:58.636597 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:58.639858 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 565/1140] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:58 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:09:58.649636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:58.649861 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:58.651557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:58.651988 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:58.653554 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5a77bbf2-3136-4b6c-b526-afc9bf82bb44 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.248132 Aug 24 05:09:58.656039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 576/1141] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:58 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:09:58.673251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.673751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.675667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.676201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.676662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.677099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.710183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-91419a70-53ce-41c1-9cbd-6f18e3ed2f0b tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069058 Aug 24 05:09:58.710681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 566/1142] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:09:58 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:58.721538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:58.723270 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:58.730854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.731501 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.732020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.732803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:58.733508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:58.733999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:58.767546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-372f24af-adbf-467b-aadc-8a49cc992a6e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be" status: 200 len: 194 microversion: 2.1 time: 0.049870 Aug 24 05:09:58.768487 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 577/1143] 10.222.0.105 () {58 vars in 1418 bytes} [Wed Aug 24 05:09:58 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:59.656751 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:59.657533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:59.676095 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:59.677037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:59.677648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:59.678594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:59.678782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:59.679521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:59.679951 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:59.680052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:59.693197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:59.706743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:59.706743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:59.706743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:59.706743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:59.707911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:59.936020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:59.939733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:59.947105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e563ec76-a3a7-4294-b7d7-b6deb45a8362 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.292707 Aug 24 05:09:59.947105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 567/1144] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:09:59 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:59.951118 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "name": "network-vif-plugged", "status": "completed", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:59.972351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:59.983266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:59.984022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:59.984149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:59.997346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:59.997514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:59.997514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c8e20c52-c560-4e02-a5ed-7c33e4dbe204 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.313354 Aug 24 05:09:59.999044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] Creating event network-vif-plugged:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:10:00.007342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 578/1145] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:09:59 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:10:00.012928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-b06d98a7-8ba6-4f90-9c2a-52646e3d888f req-547d902a-5814-4447-8918-c8edb1493ce8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065143 Aug 24 05:10:00.015343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 568/1146] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:00.970723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:00.972173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:00.974343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:00.979402 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:00.980139 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:00.980777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:00.981627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:00.982030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:00.982448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:01.027108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:01.027806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:01.039613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:01.040113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:01.040562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:01.041271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:01.041729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:01.042159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:01.223343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:01.239902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-09ca7d4d-b7e9-4032-95a9-1472f9897890 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.273074 Aug 24 05:10:01.241746 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 579/1147] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:00 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:01.261990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:01.272536 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:01.274072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:01.275307 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c9094681-46a4-452e-a879-421a697bf25c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.254014 Aug 24 05:10:01.275898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 569/1148] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:01 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:01.603769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ecc7c38-168b-4220-9327-3150d53c7ca8"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:01.606452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:01.614337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:01.665787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:01.665787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:01.665787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:01.665787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:01.667256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:02.261904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:02.262813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:02.270172 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:02.271041 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:02.271746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:02.273173 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:02.274097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:02.274616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:02.431150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:02.441052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5e8d1682-9afa-46f9-8587-bed622d3e3a4 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.182164 Aug 24 05:10:02.441052 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 570/1149] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:02 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:02.445663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:02.446267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:02.453143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:02.453633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:02.454072 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:02.454770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:02.455255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:02.455739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:02.600714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:02.609642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:02.611157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:02.627645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2e2a5038-fc3f-4d09-89af-3dd0ac19bba8 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.170705 Aug 24 05:10:02.627645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 571/1150] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:02 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:03.462323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:03.463134 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:03.470180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:03.470768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:03.471377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:03.472402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:03.472929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:03.473368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:03.623244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:03.631419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-dd3b1677-fade-4a13-930d-3eb5149d1e81 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.172862 Aug 24 05:10:03.645113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 572/1151] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:03 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:03.646265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:03.651982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:03.655327 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:03.655827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:03.656273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:03.656986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:03.657444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:03.657873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:03.838598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:03.849811 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:03.851556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:03.852835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d4812172-9a1d-4814-9196-0242f6fd86d5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.217159 Aug 24 05:10:03.853610 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 573/1152] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:03 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:04.665435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:04.666169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:04.674579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:04.675135 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:04.676055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:04.676767 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:04.677233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:04.677662 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:04.822653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:04.831524 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-059f7afc-2179-45cd-9c16-40b1b1b73cef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.169413 Aug 24 05:10:04.832349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 574/1153] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:04 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:04.878601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:04.879311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:04.886345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:04.890938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:04.890938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:04.890938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:04.890938 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:04.891984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:05.061069 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:05.078157 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:05.080024 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:05.082060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a7253fb8-6c5e-4528-8e17-01a88ba8d2af tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.208245 Aug 24 05:10:05.084529 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 575/1154] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:04 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:10:05.852805 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:05.853533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:05.860452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:05.860935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:05.861364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:05.862615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:05.863105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:05.863574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:06.006373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:06.014362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-73bccda6-2ee7-4687-9d2c-611e2b43d7cd tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.165744 Aug 24 05:10:06.023919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 576/1155] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:05 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:06.107820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:06.108746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:06.116295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:06.116937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:06.117446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:06.118232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:06.118764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:06.119334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:06.270645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:06.280575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:06.282070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:06.283690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8951727c-28a6-4939-b1ea-5d22ca94fd77 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.179644 Aug 24 05:10:06.298020 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 577/1156] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:06 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:07.035981 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:07.036787 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:07.043999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:07.044603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:07.045079 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:07.045999 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:07.046757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:07.047453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:07.203350 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:07.213235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bd49550d-e11a-4fa3-bc0c-6741e1382ba9 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.181142 Aug 24 05:10:07.214056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 578/1157] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:07 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:07.307944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:07.308647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:07.315650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:07.316122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:07.316559 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:07.317253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:07.317705 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:07.318125 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:07.476430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:07.484834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:07.486331 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:07.488345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d346c02f-8c9a-415c-b1a5-164b91352373 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.184955 Aug 24 05:10:07.488913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 579/1158] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:07 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:10:08.246511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:08.246511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:08.246511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:08.246511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:08.248520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:08.248520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:08.248520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:08.248520 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:08.385601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:08.394288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-82440af3-8f27-465e-8ce6-846eb3f29735 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.164026 Aug 24 05:10:08.394857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 580/1159] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:08 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:08.501242 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:08.517683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:08.517683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:08.517683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:08.528367 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] Creating event network-changed:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:10:08.533727 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-ef7b7daf-68df-4090-9911-56f160578f0c req-efd49829-e024-4fbc-8f78-fa9aa2aedf06 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103172 Aug 24 05:10:08.534352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 581/1160] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:08.539930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:08.540732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:08.547420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:08.552025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:08.552025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:08.552025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:08.552025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:08.552469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:08.693379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:08.702300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:08.703979 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:08.705188 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f9e560b5-c086-49da-871b-b194964873c2 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.169595 Aug 24 05:10:08.719045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 582/1161] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:08 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:09.415311 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:09.415983 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:09.422349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:09.422826 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:09.423284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:09.423977 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:09.425005 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:09.425699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:09.559044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:09.568011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8a0f23ae-d8c5-4046-863e-437cb9518b8a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.156709 Aug 24 05:10:09.568609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 583/1162] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:09 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:09.728893 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:09.729503 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:09.736043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:09.736563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:09.737784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:09.738641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:09.739137 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:09.739565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:09.874946 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:09.884154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:09.886151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:09.886834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1d67b1c5-0762-40cf-8520-f54a4b0b82b0 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.161922 Aug 24 05:10:09.887434 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 584/1163] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:09 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:10:10.589633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:10.590343 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:10.597808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:10.598298 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:10.598733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:10.599458 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:10.599909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:10.600351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:10.734358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:10.737937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=100 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:10.743287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3689729-104e-4b0d-98ba-8216b5cc2c9c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.157818 Aug 24 05:10:10.743877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 585/1164] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:10 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:10.914574 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:10.915513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:10.925197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:10.925197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:10.927888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:10.927888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:10.927888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:10.928332 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:11.077001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:11.086807 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:11.088429 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:11.089673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-85048790-e257-43f2-a3de-ec301b75b395 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.181426 Aug 24 05:10:11.090246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 586/1165] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:10 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:11.422511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7f2caa48-92c3-4a27-8b38-0c78ff9df6c4 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "POST /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.822663 Aug 24 05:10:11.423173 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 580/1166] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:10:01 2022] POST /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 194 bytes in 9824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:11.765539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:11.766074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:11.772624 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:11.773110 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:11.773550 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:11.774256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:11.774711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:11.775180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:11.912400 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:11.920084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a0d18013-5997-44b3-bf74-d635760e541e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.158595 Aug 24 05:10:11.920745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 587/1167] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:11 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:12.110893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=3 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:12.116307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:12.117002 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:12.123527 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:12.124074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:12.124543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:12.125355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:12.125834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:12.126449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:12.144377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:12.268513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:12.277410 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:12.279080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:12.280234 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f306e92f-a47b-4e37-85dc-d511b3a62962 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.170333 Aug 24 05:10:12.280800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 581/1168] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:12 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:12.942549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:12.943208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:12.950060 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:12.950571 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:12.951008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:12.951730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:12.952183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:12.952673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:13.086210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:13.094085 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4c3bdae1-a492-420a-a510-b5ba37a91f50 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.156142 Aug 24 05:10:13.094653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 588/1169] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:12 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:13.305218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:13.305833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:13.313136 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:13.313617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:13.314052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:13.314779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:13.315281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:13.315715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:13.452736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:13.461475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:13.463154 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:13.464328 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-89fd3162-2b96-4856-b044-3094743b4ecb tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.163733 Aug 24 05:10:13.464896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 582/1170] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:13 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:14.115384 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:14.116101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:14.118485 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=74 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:14.123500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:14.123922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:14.124356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:14.125043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:14.125493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:14.125973 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:14.258714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:14.266493 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-97fbb9f7-2a9e-4d42-905d-761e2912851e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.155653 Aug 24 05:10:14.267075 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 589/1171] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:14 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:14.489442 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:14.489990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:14.496473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:14.496949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:14.497384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:14.498081 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:14.498534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:14.498956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:14.630450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:14.638961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:14.640491 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:14.641666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-321f0f04-96a2-413a-9d6e-40d0c0f9b25b tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.156899 Aug 24 05:10:14.642304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 583/1172] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:14 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:15.287496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:15.288204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:15.295785 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:15.296277 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:15.296722 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:15.297441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:15.297901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:15.298333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:15.447100 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:15.455406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-210f587c-4386-4bf7-b0b2-665a76bf25e2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.171828 Aug 24 05:10:15.456406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 590/1173] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:15 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:15.665906 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:15.666885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:15.674177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:15.674943 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:15.675494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:15.676923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:15.677758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:15.678462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:15.844667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:15.853923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:15.855420 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:15.860115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f17a64df-efc0-4636-be17-bc6f8d6f5873 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1734 microversion: 2.20 time: 0.195199 Aug 24 05:10:15.860115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 584/1174] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:15 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:10:16.478123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:16.478677 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:16.485465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:16.489470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:16.489470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:16.489470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:16.489470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:16.489952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:16.628479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:16.637772 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-54d275a4-1b72-4d3d-a41c-71e3951ca5e3 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.164482 Aug 24 05:10:16.638362 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 591/1175] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:16 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:16.880251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:16.880859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:16.887451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:16.887936 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:16.888373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:16.889067 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:16.889523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:16.890003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:17.023662 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:17.032129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:17.033610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:17.034754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4e7e4286-791d-47d5-bef0-b5aa80088478 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1721 microversion: 2.20 time: 0.158515 Aug 24 05:10:17.035350 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 585/1176] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:10:16 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:10:17.215648 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:17.216142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:17.222369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:17.222859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:17.224278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:17.225039 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:17.225616 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:17.226082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:17.251500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0ed629fc-8d48-4fba-b23a-bd35a0bc207b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039831 Aug 24 05:10:17.252101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 592/1177] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:10:17 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:17.659235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:17.659849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:17.667052 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:17.667532 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:17.667965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:17.668667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:17.669116 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:17.670732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:17.817123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:17.826782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bd1bde3d-3c8b-4131-9cad-3bd71b2d6745 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.171588 Aug 24 05:10:17.827647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 586/1178] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:17 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:18.021215 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "name": "network-vif-plugged", "status": "completed", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:18.030680 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:18.031294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:18.031908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:18.043330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] Creating event network-vif-plugged:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:10:18.048300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-2529d4fa-b018-4793-9a85-1b6e09e32dec req-939eede3-cb48-45bb-bcab-7fcfa3c5220b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090312 Aug 24 05:10:18.048959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 593/1179] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:18.851692 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:18.852315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:18.858972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:18.859495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:18.859931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:18.860665 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:18.861124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:18.861552 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:19.013285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:19.022447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dbb58d01-45a1-4d59-a380-2d6494e3dbcf tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.174196 Aug 24 05:10:19.023032 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 587/1180] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:18 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:20.044554 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9f6c165-5c1a-4958-9a75-9b1d5c759d72"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:20.046577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:20.047830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:20.048271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:20.055191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.055495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.055994 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.056341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.056469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.057048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.057196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.057590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.058018 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.058236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.058701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.059162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.205417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:20.214409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ecbc08c7-b836-46c3-8ff2-6cd848037248 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1362 microversion: 2.1 time: 0.173098 Aug 24 05:10:20.214913 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 588/1181] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:20 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:20.220793 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:20.223152 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:20.234383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.234881 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.238448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.238448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.238448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.238448 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.269318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2a4b6def-e4c9-4dfb-bb83-ae729f54f7df tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053310 Aug 24 05:10:20.269879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 589/1182] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:20 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:20.414819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:20.415333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:20.421647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.422133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.422560 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.423287 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.423735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.424150 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.455901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5c07a940-1136-4807-8d11-7a4c6c238d6c tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be" status: 200 len: 194 microversion: 2.1 time: 0.044928 Aug 24 05:10:20.456488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 590/1183] 10.222.0.105 () {58 vars in 1418 bytes} [Wed Aug 24 05:10:20 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:20.467538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:20.467538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:20.472836 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.473315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.473747 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.474642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:20.475314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:20.475837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:20.561620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'services' on Instance uuid 248db6cc-ec73-4414-811e-f609ddab4135 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:20.804213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f744bd4f-5ee5-490b-b488-083b8a180fe8 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be" status: 202 len: 0 microversion: 2.1 time: 0.341229 Aug 24 05:10:20.804816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 591/1184] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:10:20 2022] DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/90a9fc03-8a86-4e49-aaca-135fde9404be => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:10:21.237535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:21.238617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:21.246014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.246651 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.247346 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.248102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.248829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.249249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.391339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:21.400331 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-94ae4965-40e2-4ea4-8196-e57f9e42381c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1552 microversion: 2.1 time: 0.168054 Aug 24 05:10:21.400950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 592/1185] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:21 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:21.420901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:21.421531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:21.428312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.432157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.432157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.432157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.432157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.432553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.434302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7a4edccc-d8fa-4ffc-80f7-89bcf6c31428 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "POST /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.395896 Aug 24 05:10:21.435272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 594/1186] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:10:20 2022] POST /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 194 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:21.580014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:21.588109 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5b88f975-975f-4a4c-b918-d6f81cac17a5 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1552 microversion: 2.1 time: 0.170878 Aug 24 05:10:21.588686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 593/1187] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:21 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:21.611306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:21.616946 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:21.617757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Searching by: {'deleted': False, 'project_id': '67112706d4df4183bc338732b237df6e'} {{(pid=122276) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 05:10:21.624820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.625352 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.625791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.626518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.626976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.627504 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.723611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.multi_cell_list [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122276) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 05:10:21.820470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-61d28618-7a88-4098-b478-eded635d6c46 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.213435 Aug 24 05:10:21.821066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 595/1188] 10.222.0.105 () {58 vars in 1130 bytes} [Wed Aug 24 05:10:21 2022] GET /compute/v2.1/servers => generated 344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:21.832457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:21.833163 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:21.839526 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.840006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.840438 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.841153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:21.841584 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:21.842009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:21.985481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:21.993945 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b08c6dab-2652-4ec8-ac49-6772432a3f17 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1552 microversion: 2.1 time: 0.165289 Aug 24 05:10:21.994520 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 594/1189] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:21 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:23.016634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:23.017254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:23.024666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.025674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.025674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.026322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.026762 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.027380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.059285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1671be68-4ad9-4f42-a99d-a0fcda799e02 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/2ecc7c38-168b-4220-9327-3150d53c7ca8" status: 200 len: 194 microversion: 2.1 time: 0.046519 Aug 24 05:10:23.059896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 596/1190] 10.222.0.105 () {58 vars in 1418 bytes} [Wed Aug 24 05:10:23 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/2ecc7c38-168b-4220-9327-3150d53c7ca8 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:23.071839 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:23.072572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:23.079228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.079729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.080149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.080854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.081312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.081734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.167286 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'services' on Instance uuid 248db6cc-ec73-4414-811e-f609ddab4135 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:23.452256 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dfa87bf9-f030-413a-8a09-3f301e726b7a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/2ecc7c38-168b-4220-9327-3150d53c7ca8" status: 202 len: 0 microversion: 2.1 time: 0.385170 Aug 24 05:10:23.452762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 595/1191] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:10:23 2022] DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments/2ecc7c38-168b-4220-9327-3150d53c7ca8 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:10:23.975706 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f465c014-7152-4a4e-b58e-f17b8a3d5630"}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:23.978200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:23.984409 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.984896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.985334 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.986038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.986502 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.986925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:24.800855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d8819fcd-e3bb-43f4-9c0e-bf06ff85d962 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828641 Aug 24 05:10:24.801669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 597/1192] 10.222.0.105 () {60 vars in 1328 bytes} [Wed Aug 24 05:10:23 2022] POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:27.948647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:27.949089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:27.957299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:27.959639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:27.960349 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:27.960789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:27.975371 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] Creating event network-changed:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:10:27.975615 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:27.975615 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:27.975946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:27.976905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:27.978497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-c5b95570-6d33-43c5-aa73-a6e93431dacc req-7f35d854-6794-4b93-9043-a2ac59a73ed6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035180 Aug 24 05:10:27.979011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:27.979557 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:27.979742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 598/1193] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:28.012324 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:10:28.015863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:28.309720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ffdc42fe-6728-4a21-91dc-e8b857aca8e9 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "DELETE /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 204 len: 0 microversion: 2.1 time: 0.369763 Aug 24 05:10:28.310555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 596/1194] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:27 2022] DELETE /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:10:28.319827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:28.320528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:28.326997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:28.327513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:28.327953 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:28.328698 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:28.329132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:28.329558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:28.478533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:28.487286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-946401f1-0028-437c-99a4-76d0084b40b6 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.172237 Aug 24 05:10:28.487868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 599/1195] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:28 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:29.510177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:29.510864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:29.517563 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:29.518039 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:29.518468 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:29.519198 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:29.519649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:29.520070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:29.657857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:29.666832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a51af269-8330-4ede-8ab7-d0716d8f89a1 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.161848 Aug 24 05:10:29.667509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 597/1196] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:29 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:30.689385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:30.690029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:30.697459 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:30.697956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:30.698391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:30.699126 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:30.699614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:30.700043 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:30.843357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:30.852279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f85a8a07-05d7-4cda-8d93-69129462c545 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1569 microversion: 2.1 time: 0.166828 Aug 24 05:10:30.852873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 600/1197] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:30 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:31.421207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:31.421901 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:31.430145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.430738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.431396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.432178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.432726 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.433214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.516177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f2c50c-6e43-4245-a8a2-b7455d391882", "name": "network-vif-deleted", "tag": "b5e316a8-f9f0-439d-84be-e2996d1da2a4"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:31.529984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.530470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.530957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.531369 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lazy-loading 'services' on Instance uuid 7624c5ef-86bd-4c16-a264-57b62be9970c {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:31.535247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:31.544000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] Creating event network-vif-deleted:b5e316a8-f9f0-439d-84be-e2996d1da2a4 for instance 11f2c50c-6e43-4245-a8a2-b7455d391882 on hv-cinder-85426 Aug 24 05:10:31.549369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-27e71ddd-5e1d-436a-9f0e-a3d2ff5e0bb4 req-7277c10f-2c2f-4cc0-bf22-36853d44c048 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041426 Aug 24 05:10:31.550696 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 601/1198] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:31.798666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bd6494ee-83ef-487d-b0da-962404a97c3d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments/f9f6c165-5c1a-4958-9a75-9b1d5c759d72" status: 202 len: 0 microversion: 2.1 time: 0.381930 Aug 24 05:10:31.799322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 598/1199] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:10:31 2022] DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments/f9f6c165-5c1a-4958-9a75-9b1d5c759d72 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:31.811261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:31.813838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:31.817452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:31.825913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.826406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.826873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.827580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.828035 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.828465 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.870267 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-63f929b7-68e1-4900-94fb-8228dd7db6cb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064683 Aug 24 05:10:31.871273 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 602/1200] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:31 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:31.886998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:31.888444 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:31.899229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.900141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.900880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.902053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.902807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.904558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.987999 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:31.997293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7e752413-4701-4e68-ad7f-d872a5d79c34 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1220 microversion: 2.1 time: 0.114524 Aug 24 05:10:31.997879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 599/1201] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:31 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:32.890748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:32.890748 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:32.896294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:32.896823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:32.897441 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:32.898313 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:32.898773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:32.899241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:32.931667 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1208b98a-a780-419d-8fc8-2c2aa320bf9c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051588 Aug 24 05:10:32.932305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 603/1202] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:32 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:33.020325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.021746 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.027917 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.028408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.028848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.029767 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.030228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.030713 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.067462 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.067948 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.068568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.069032 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lazy-loading 'fault' on Instance uuid 11f2c50c-6e43-4245-a8a2-b7455d391882 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:33.111523 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb6ab7a2f344a069010a3385d2fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6379a0607459187075dfcd968d706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:33.120768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-94bb7d90-a59b-47a8-bb26-bb68882bc750 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 200 len: 1225 microversion: 2.1 time: 0.105451 Aug 24 05:10:33.121617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 600/1203] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:33.211912 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.214663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.221342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.222845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.222845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.223272 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.223585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.224051 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.254959 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-eb245ebe-2604-4600-b6c3-af46e239e747 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047669 Aug 24 05:10:33.255589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 604/1204] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:10:33.378064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.380395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.386827 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.387344 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.387842 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.388511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.388962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.389384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.421390 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f5a74859-5850-49ae-a11b-67da86302900 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047325 Aug 24 05:10:33.421975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 601/1205] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:10:33.489136 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.489633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.496271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.496763 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.497202 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.497903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.498369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.498834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.524873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:10:33.812921 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-d96bfcc6-5b4a-4e6d-a19e-ead51db8ae25 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 204 len: 0 microversion: 2.1 time: 0.327318 Aug 24 05:10:33.813515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 605/1206] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:33 2022] DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:10:33.822445 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.823128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.829947 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.830484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.830923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.831678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.832115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.832543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.946707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.951966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.955614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.956104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.956539 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.957239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.957688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.958104 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.970171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:33.978661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7b2e6bd6-d5a3-4222-983b-317d94bdcb16 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1676 microversion: 2.1 time: 0.160707 Aug 24 05:10:33.979267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 602/1207] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:33.990833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-19446ab4-9e19-45dc-9a41-b3bda015e1aa tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049080 Aug 24 05:10:33.991448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 606/1208] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:34.142418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:34.143036 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] [instance: 11f2c50c-6e43-4245-a8a2-b7455d391882] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:34.150003 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:34.150480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:34.150912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:34.151670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:34.152128 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:34.152550 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:34.167281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] HTTP exception thrown: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Request method failure captured: Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 HTTP/1.1 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbFElVv7SQPm5hopODbSD23h1bp63dTEDbTzLC0UlgHsnRPc2lvy_JfFpWLRO4t6v9trJ1kbswflRfShM1qKZfK1i9XKuJihja92UAsrEubZLY9UIbvTf_2uQzj-b4t7czulGr8gsg0bjYuFhgRuvelv6-Tuw6QtG7FcGyLERUP7vZI Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: f6a6379a0607459187075dfcd968d706 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-TestShelveInstance-2069034511 Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:34.169043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6a6379a0607459187075dfcd968d706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f6a6379a0607459187075dfcd968d706", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f6a6379a0607459187075dfcd968d706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6a6379a0607459187075dfcd968d706"}]}] Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-TestShelveInstance-2069034511 Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: f6a6379a0607459187075dfcd968d706 Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-TestShelveInstance-2069034511 Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-TestShelveInstance-2069034511-project Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: bfb6ab7a2f344a069010a3385d2fcf59 Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-TestShelveInstance-2069034511-project Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. Aug 24 05:10:34.171443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '11f2c50c-6e43-4245-a8a2-b7455d391882'} Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:34.173046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. Aug 24 05:10:34.175775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:34.179697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Returning 404 to user: Instance 11f2c50c-6e43-4245-a8a2-b7455d391882 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:34.179697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4f780609-0045-4a54-9ee2-461494086b16 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882" status: 404 len: 111 microversion: 2.1 time: 0.031906 Aug 24 05:10:34.179697 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 603/1209] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:34 2022] GET /compute/v2.1/servers/11f2c50c-6e43-4245-a8a2-b7455d391882 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:34.443947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b45758a4-422c-4d36-a0f2-8e91906bb610 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] Calling method '.version_select at 0x7fde5e508310>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:34.519255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b45758a4-422c-4d36-a0f2-8e91906bb610 tempest-TestShelveInstance-2069034511 tempest-TestShelveInstance-2069034511-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-244626428" status: 202 len: 0 microversion: 2.1 time: 0.079191 Aug 24 05:10:34.521937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 607/1210] 10.222.0.105 () {58 vars in 1256 bytes} [Wed Aug 24 05:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-244626428 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:35.001478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:35.002093 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:35.004819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:35.007622 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:35.008755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.009229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.009869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.010744 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.011395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.011825 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.014503 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.015042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.015689 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.016403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.017711 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.018151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.072718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8de812f9-4d0a-4759-9346-35ea832971e8 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072968 Aug 24 05:10:35.073345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 608/1211] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:34 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:35.167106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:35.172614 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fb8a104c-d8f5-41db-98d3-588b6bf8cba5 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1676 microversion: 2.1 time: 0.175062 Aug 24 05:10:35.173360 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 604/1212] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:34 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:36.086254 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.090226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.101083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.101883 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.102634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.104278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.112073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.112073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.157770 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3440cce-deae-4ff8-bdc3-d6fc9f21d97b tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077464 Aug 24 05:10:36.158468 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 609/1213] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:36 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:36.194837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.195488 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.202643 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.203190 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.203646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.204388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.204847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.205275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.359500 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:36.368518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2e5a6690-11f6-47e5-9958-e69224018638 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1676 microversion: 2.1 time: 0.178465 Aug 24 05:10:36.369019 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 605/1214] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:36 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:37.170723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.173834 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.183931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.184628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.184892 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.185595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.186049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.186472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.220183 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1a5dd274-48d6-4b02-b7bf-7f2eb37de2a4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054114 Aug 24 05:10:37.220753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 610/1215] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:37.390329 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.390931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.398675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.398675 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.399136 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.400195 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.401604 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.402200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.496071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:37.507362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f64fce85-b6f3-4d9d-a269-a0cfd5cd8e0a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1609 microversion: 2.1 time: 0.121048 Aug 24 05:10:37.508962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 606/1216] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:37.829175 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248db6cc-ec73-4414-811e-f609ddab4135", "name": "network-vif-deleted", "tag": "a548c47d-2d76-4053-b9e8-abe497478a7b"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:37.850634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.853875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.854473 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.884990 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] Creating event network-vif-deleted:a548c47d-2d76-4053-b9e8-abe497478a7b for instance 248db6cc-ec73-4414-811e-f609ddab4135 on hv-cinder-85426 Aug 24 05:10:37.898903 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-f037cb05-780f-4c69-8af3-25d75637d288 req-a1571e39-721a-4f8b-a3ae-ec13b24719c5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073817 Aug 24 05:10:37.902948 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 611/1217] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:38.232583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.234868 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.241281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.241765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.242205 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.243065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.243533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.244031 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.277465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ffac1d67-0a0c-4d59-b50c-464cb13e26fd tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048911 Aug 24 05:10:38.278048 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 607/1218] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:38.535290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.536671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.572236 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.574062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.574784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.576132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.577782 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.578682 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.645850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.645850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.645850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.645850 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'fault' on Instance uuid 248db6cc-ec73-4414-811e-f609ddab4135 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:38.808928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:38.818096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a7f8ea42-ca9b-4973-b803-54f7a96dff78 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1330 microversion: 2.1 time: 0.290766 Aug 24 05:10:38.820141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 612/1219] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1330 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:39.291180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.293230 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.299740 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.300210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.300900 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.301619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.302061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.302479 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.332887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9e0d2b17-a8d6-4193-a372-1f1319789aec tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Aug 24 05:10:39.333463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 608/1220] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:39.846078 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.847971 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.855919 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.856643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.857247 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.858131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.858745 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.859373 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.901021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.901761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.902344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.902945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lazy-loading 'fault' on Instance uuid 248db6cc-ec73-4414-811e-f609ddab4135 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:39.974406 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11da4dac5804252b7310be096ae5d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6824ae6edd43fcbddb58581134098c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:39.986584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-17ec78fd-22f7-4574-afac-ece6267017e7 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 200 len: 1330 microversion: 2.1 time: 0.145021 Aug 24 05:10:39.986584 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 613/1221] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:40.347102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:40.351362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:40.358929 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.359501 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.362494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.362494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.362494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.362494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.398183 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d056a7b2-c5d7-4b5a-8dea-230352035c4d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055712 Aug 24 05:10:40.398809 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 609/1222] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:40 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:41.012007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.012926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.019688 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.020476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.020922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.021716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.022499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.023048 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.043597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 HTTP/1.1 Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:41.045827 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:41.047480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '248db6cc-ec73-4414-811e-f609ddab4135'} Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:41.048501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:41.049995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:41.051445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:41.051445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-32de6ef4-c35d-4e5b-8a51-ff8862058f2a tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 404 len: 111 microversion: 2.1 time: 0.041338 Aug 24 05:10:41.051445 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 614/1223] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:41.069506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d1a8c91d-78ed-43b7-92c8-8853868f7300 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '.version_select at 0x7fde5e1d8e50>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.118831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.120089 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.128128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.128627 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.129053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.129759 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.130209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.130628 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.237014 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d1a8c91d-78ed-43b7-92c8-8853868f7300 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460013401" status: 202 len: 0 microversion: 2.1 time: 0.181743 Aug 24 05:10:41.238349 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 610/1224] 10.222.0.105 () {58 vars in 1223 bytes} [Wed Aug 24 05:10:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460013401 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:41.275689 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:41.285105 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-32e7769a-8385-4fb3-8096-38cc75e85598 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1598 microversion: 2.1 time: 0.171320 Aug 24 05:10:41.285892 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 615/1225] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:41.414025 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.416942 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.424229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.424722 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.425160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.426341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.426808 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.427303 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.457409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b74bda76-7811-4852-82b6-982d7b375442 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048439 Aug 24 05:10:41.457988 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 611/1226] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:10:41.527456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.528159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.535599 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.536342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.536942 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.538295 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.538750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.539344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.567497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:10:41.728455 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:41.977310 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-18e5207f-d160-44dc-b501-0c4dc17f79c9 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 204 len: 0 microversion: 2.1 time: 0.453438 Aug 24 05:10:41.978558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 616/1227] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:41 2022] DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:10:41.988228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.989802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.998288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.999748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.000783 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.002217 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.004208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.007439 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.026411 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:42.277379 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:42.288558 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f8e4867d-9e78-4d69-9171-b723ee2eefb4 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1685 microversion: 2.1 time: 0.304790 Aug 24 05:10:42.299098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 612/1228] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1685 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:43.312848 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.313969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.324011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.324743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.325439 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.326456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.326992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.327531 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.626560 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:43.635469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b2352f20-8210-4d9b-b14e-bd2cf4089718 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1685 microversion: 2.1 time: 0.326899 Aug 24 05:10:43.647302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 617/1229] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1685 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:44.639495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:44.644919 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:44.654652 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.655471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.656154 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.660932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:44.662900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:44.665139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:44.673019 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.674182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] Creating event network-changed:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:10:44.674315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.674567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.675829 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.676567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.677037 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.688304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-bdbd7b17-7154-4935-9455-d9ac2a4226a7 req-c8e41324-fcc1-4e00-983d-5d255fba06a1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160804 Aug 24 05:10:44.694509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 613/1230] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:44.913026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:44.921128 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a47e10a1-4b88-4ef4-9b86-396699794d5c tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1618 microversion: 2.1 time: 0.266083 Aug 24 05:10:44.922029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 618/1231] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:44 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1618 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:45.530897 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7624c5ef-86bd-4c16-a264-57b62be9970c", "name": "network-vif-deleted", "tag": "2d4b0199-ca0b-4705-b975-4d9ce0a6650e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:45.560656 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.565364 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.566405 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.598235 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] Creating event network-vif-deleted:2d4b0199-ca0b-4705-b975-4d9ce0a6650e for instance 7624c5ef-86bd-4c16-a264-57b62be9970c on hv-cinder-85426 Aug 24 05:10:45.605213 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.606123 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.621567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-db1eea85-fd91-4ccd-b6eb-58e095bf8fcc req-e729dc0c-5ac8-4db2-95c0-6696c4e8dba5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096695 Aug 24 05:10:45.622810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 614/1232] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:45.629544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.630951 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.632286 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.633222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.634930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.636585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.672364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 HTTP/1.1 Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:45.679716 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.681444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '248db6cc-ec73-4414-811e-f609ddab4135'} Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:45.682548 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.684133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.688200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:45.689285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-60f22f6f-2084-4acf-967e-96725b76cb5e tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 404 len: 111 microversion: 2.1 time: 0.089264 Aug 24 05:10:45.689862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 619/1233] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:45 2022] DELETE /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:45.701312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.702213 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 248db6cc-ec73-4414-811e-f609ddab4135] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.731666 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.732181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.732633 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.739471 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.740075 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.742871 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.785030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 HTTP/1.1 Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:45.789932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.791642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '248db6cc-ec73-4414-811e-f609ddab4135'} Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:45.792714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. Aug 24 05:10:45.794239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:45.812570 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 248db6cc-ec73-4414-811e-f609ddab4135 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:45.814207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-7c56edd2-4a8f-4dfd-9cb7-f11997659640 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135" status: 404 len: 111 microversion: 2.1 time: 0.118619 Aug 24 05:10:45.819606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 615/1234] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:45 2022] GET /compute/v2.1/servers/248db6cc-ec73-4414-811e-f609ddab4135 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:45.946907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.947567 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.954840 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.955718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.956348 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.957617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.958328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.959810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.053335 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45111c49aa74f76874d3a0c747034ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad6d7352bc144929743ca7373a41800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:46.070966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3ce84fa0-9a10-4bf9-b45c-8227a3069f43 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 200 len: 1331 microversion: 2.1 time: 0.130057 Aug 24 05:10:46.079305 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 620/1235] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:45 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:47.102111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.103391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.111648 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.114366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.114366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.114366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.114366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.115056 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.139417 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c HTTP/1.1 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:47.140980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:47.142580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '7624c5ef-86bd-4c16-a264-57b62be9970c'} Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:47.143517 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:47.144751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.145879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:47.145879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-73b7a809-6edc-454f-b3a6-4b98848a81c2 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 404 len: 111 microversion: 2.1 time: 0.045837 Aug 24 05:10:47.145879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 616/1236] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:47 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:47.152398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b75d38f5-18ff-4bab-a55e-f9a2122fb403 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '.version_select at 0x7fde5e1e29d0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.288403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.288927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.295480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.295973 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.296475 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.298693 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.298802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b75d38f5-18ff-4bab-a55e-f9a2122fb403 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637687447" status: 202 len: 0 microversion: 2.1 time: 0.150452 Aug 24 05:10:47.298912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.299007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 621/1237] 10.222.0.105 () {58 vars in 1226 bytes} [Wed Aug 24 05:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637687447 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:47.299144 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.315658 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 HTTP/1.1 Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:47.317242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.319071 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '676b64f6-0ef9-4250-8e40-a7c922046984'} Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:47.319937 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.321140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.324877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:47.324877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-12d5d7fc-e411-4aad-bbca-ea8e25f520fe tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 404 len: 111 microversion: 2.1 time: 0.034808 Aug 24 05:10:47.324877 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 617/1238] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:47 2022] DELETE /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:10:47.329517 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.330735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] [instance: 676b64f6-0ef9-4250-8e40-a7c922046984] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.338235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.338738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.339692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.341633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.342178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.342613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.359913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] HTTP exception thrown: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Request method failure captured: Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 HTTP/1.1 Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA1tN2-ubnSuJPEOsgg6IBrJJj6pf83kQq8fEnK2YltOtSY151_HNgra7357PWZgXBOjfO6jgICna6CfpfrgYJHtqUJgrNEWa88WsnWFXoU25YmHnAXee6Cd2RJHuT9AcEZVjOSYp0X4rymJWfQW5u_cwGS9VnuOFAzcuXxSfCYNEw Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:47.361713 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd6824ae6edd43fcbddb58581134098c", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd6824ae6edd43fcbddb58581134098c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd6824ae6edd43fcbddb58581134098c"}]}] Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: bd6824ae6edd43fcbddb58581134098c Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932029058 Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: b11da4dac5804252b7310be096ae5d53 Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeTestJSON-932029058-project Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.363355 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '676b64f6-0ef9-4250-8e40-a7c922046984'} Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:47.364251 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. Aug 24 05:10:47.368556 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:47.369844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] Returning 404 to user: Instance 676b64f6-0ef9-4250-8e40-a7c922046984 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:47.369844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5da8432b-8a70-4e43-a4bb-d843a45e7836 tempest-AttachVolumeTestJSON-932029058 tempest-AttachVolumeTestJSON-932029058-project] 10.222.0.105 "GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984" status: 404 len: 111 microversion: 2.1 time: 0.039491 Aug 24 05:10:47.369844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 622/1239] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:47 2022] GET /compute/v2.1/servers/676b64f6-0ef9-4250-8e40-a7c922046984 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:49.260322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-917840049"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:49.260322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:49.272978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.272978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.279738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.280566 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.281054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.281499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.558037 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.network.security_group_api [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Adding security group 6c1d6530-abe6-4e74-9cb9-e5b7b79c1682 to port 99121297-4f7c-4781-a86a-671bcdda3a4e Aug 24 05:10:50.097484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.098067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.106934 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.107464 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.107897 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.108647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.109053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.109475 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.128380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c HTTP/1.1 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:50.129907 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.131595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '7624c5ef-86bd-4c16-a264-57b62be9970c'} Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:50.133117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.135659 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.138322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:50.138322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ade2fea4-9187-4420-a655-3b5969a6d7ce tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 404 len: 111 microversion: 2.1 time: 0.038260 Aug 24 05:10:50.138322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 623/1240] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:50 2022] DELETE /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:50.140478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.141083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7624c5ef-86bd-4c16-a264-57b62be9970c] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.147255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.147908 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.148341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.149096 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.149549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.149966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.165163 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c HTTP/1.1 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:50.166746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.168487 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '7624c5ef-86bd-4c16-a264-57b62be9970c'} Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:50.169422 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. Aug 24 05:10:50.171167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:50.172466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7624c5ef-86bd-4c16-a264-57b62be9970c could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:50.172466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b91f7c20-110e-4ed1-a221-8a5b8802bc8d tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c" status: 404 len: 111 microversion: 2.1 time: 0.031445 Aug 24 05:10:50.172466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 624/1241] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:50 2022] GET /compute/v2.1/servers/7624c5ef-86bd-4c16-a264-57b62be9970c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:50.246677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-00695c83-95d1-4cfa-bc7d-c7e315b8b3c7 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action" status: 202 len: 0 microversion: 2.1 time: 0.992753 Aug 24 05:10:50.250769 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 618/1242] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:10:49 2022] POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:50.256231 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.256920 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.264083 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.264629 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.265070 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.266894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.267867 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.267993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.282572 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:50.299044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.310974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.311720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.342841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] Creating event network-changed:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:10:50.360141 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-3e8a2dcb-c160-4458-a188-d3be3988216c req-86302c53-ad39-4d6f-a0a2-aaaf90225bd1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091531 Aug 24 05:10:50.361436 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 619/1243] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:50.892909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:50.903325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-719e16de-edd0-48ee-9981-05dfd5fa0b72 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1763 microversion: 2.1 time: 0.650949 Aug 24 05:10:50.904177 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 625/1244] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:50 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1763 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:51.561226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.562930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.574362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.575241 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.575977 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.576949 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.577623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.578298 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.597546 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a HTTP/1.1 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:51.599923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.601671 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '7ce53a28-5b5b-4fec-a80c-c3b80329e14a'} Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:51.602594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.604200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.606608 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:51.607810 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b9cc0b94-61ac-4d5a-8e71-6848fbe201bb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 404 len: 111 microversion: 2.1 time: 0.051697 Aug 24 05:10:51.608969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 620/1245] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:51 2022] DELETE /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:10:51.617381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.620209 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 7ce53a28-5b5b-4fec-a80c-c3b80329e14a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.627604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.628476 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.629023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.629906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.630472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.631730 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.649044 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a HTTP/1.1 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:51.649969 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.652470 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '7ce53a28-5b5b-4fec-a80c-c3b80329e14a'} Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:51.653365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. Aug 24 05:10:51.655671 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.658148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 7ce53a28-5b5b-4fec-a80c-c3b80329e14a could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:51.658148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1f3db010-c6d7-4390-815f-9242c86e2beb tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a" status: 404 len: 111 microversion: 2.1 time: 0.040436 Aug 24 05:10:51.659587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 626/1246] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:51 2022] GET /compute/v2.1/servers/7ce53a28-5b5b-4fec-a80c-c3b80329e14a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:10:51.665698 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.666465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.679486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.680710 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.681325 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.682225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.682847 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.683460 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.703220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 HTTP/1.1 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:51.704816 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.706567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '281bea80-9e0d-435a-9fb8-6d5aa8cf3463'} Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:51.707708 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.708940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.710968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:51.710968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a6b61ab7-43ee-44b7-8653-bdafc1f7d807 tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 404 len: 111 microversion: 2.1 time: 0.045344 Aug 24 05:10:51.710968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 621/1247] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:51 2022] DELETE /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:10:51.716156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.716894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 281bea80-9e0d-435a-9fb8-6d5aa8cf3463] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.724936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.726042 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.726733 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.727718 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.728394 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.729227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.745643 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 HTTP/1.1 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:51.747535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.749178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '281bea80-9e0d-435a-9fb8-6d5aa8cf3463'} Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:51.750111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. Aug 24 05:10:51.751641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:51.752956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 281bea80-9e0d-435a-9fb8-6d5aa8cf3463 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:51.752956 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a4e02453-a1ee-4016-9cfe-f5103bd71fae tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463" status: 404 len: 111 microversion: 2.1 time: 0.038389 Aug 24 05:10:51.756537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 627/1248] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:51 2022] GET /compute/v2.1/servers/281bea80-9e0d-435a-9fb8-6d5aa8cf3463 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:53.142731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:53.142731 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:53.150593 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.150899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.151629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.152376 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.152840 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.153273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 HTTP/1.1 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:10:53.180506 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.182215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '13e6825c-7456-4e46-8158-e15a11ced942'} Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:53.183577 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.185609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.186849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:53.186849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-afd12b65-cf5d-4d44-b985-8f525e8ee7de tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 404 len: 111 microversion: 2.1 time: 0.041949 Aug 24 05:10:53.186849 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 622/1249] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:10:53 2022] DELETE /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:53.195818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:53.196549 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] [instance: 13e6825c-7456-4e46-8158-e15a11ced942] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:53.203297 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.203910 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.205857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.205857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.205857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.206207 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.222082 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] HTTP exception thrown: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Request method failure captured: Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 HTTP/1.1 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbAynm_Ln82nDObi2QFiDfp0m9Ez9S7gocsZVFJtLpPxeL6kGOOdE2Xfeg4qjWbWnzcmXEfHvbQCz4k5mBmCiuLYxo5ZrFJd1nDiS4R0SyiU2plHhTnW1FJQ1lHCvwtPseibUxcbAhLdCVDkY0xq-Vl_ozkkBJZGRhZJsCEELlLnuTc Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:10:53.223750 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fad6d7352bc144929743ca7373a41800", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fad6d7352bc144929743ca7373a41800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fad6d7352bc144929743ca7373a41800"}]}] Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: fad6d7352bc144929743ca7373a41800 Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1591154440 Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: e45111c49aa74f76874d3a0c747034ba Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeNegativeTest-1591154440-project Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.226915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '13e6825c-7456-4e46-8158-e15a11ced942'} Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:53.228842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. Aug 24 05:10:53.231113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:10:53.242857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] Returning 404 to user: Instance 13e6825c-7456-4e46-8158-e15a11ced942 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:53.242857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-79d3ebf9-9999-4027-8053-29cd034c547f tempest-AttachVolumeNegativeTest-1591154440 tempest-AttachVolumeNegativeTest-1591154440-project] 10.222.0.105 "GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942" status: 404 len: 111 microversion: 2.1 time: 0.037093 Aug 24 05:10:53.242857 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 628/1250] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:10:53 2022] GET /compute/v2.1/servers/13e6825c-7456-4e46-8158-e15a11ced942 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:59.460788 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2935a249-1507-42b3-999c-3813b3c44e00 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Action: 'create', calling method: .version_select at 0x7fde5e159af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2101457849", "metadata": {"Type": "work"}}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:00.216803 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2935a249-1507-42b3-999c-3813b3c44e00 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.876821 Aug 24 05:11:00.217457 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 623/1251] 10.222.0.105 () {60 vars in 1161 bytes} [Wed Aug 24 05:10:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 878 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 24 05:11:00.229747 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-665a3dfc-2809-47dc-a06e-93b57095d33a tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e2028b0>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:00.284322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-665a3dfc-2809-47dc-a06e-93b57095d33a tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 353 microversion: 2.1 time: 0.058342 Aug 24 05:11:00.284902 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 629/1252] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:00 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:01.298177 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6ac533f2-6b89-440b-9601-3e4d219ae099 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e1bfca0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:01.347940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6ac533f2-6b89-440b-9601-3e4d219ae099 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 353 microversion: 2.1 time: 0.053887 Aug 24 05:11:01.348508 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 624/1253] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:01 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:02.362290 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1d335c87-13c8-43da-8a08-0f6e331a89cf tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e6d6700>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:02.413097 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1d335c87-13c8-43da-8a08-0f6e331a89cf tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 353 microversion: 2.1 time: 0.055228 Aug 24 05:11:02.413721 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 630/1254] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:02 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:03.425064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=19 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:03.425807 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=25 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:03.430000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-910d990a-f994-4b2e-93ed-b3c6a2233249 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e72edc0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.481882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-910d990a-f994-4b2e-93ed-b3c6a2233249 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 354 microversion: 2.1 time: 0.058083 Aug 24 05:11:03.482456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 625/1255] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:03.491590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:03.492391 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=38 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:03.498180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-93dd4a92-0673-45db-8c05-edef6397384f tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde62bdf430>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.546841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-93dd4a92-0673-45db-8c05-edef6397384f tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 354 microversion: 2.1 time: 0.055945 Aug 24 05:11:03.547527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 631/1256] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:03.566551 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-03c88c44-517e-43fa-b43e-ae05f1913135 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e1d8f70>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.808921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-03c88c44-517e-43fa-b43e-ae05f1913135 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 202 len: 0 microversion: 2.1 time: 0.246289 Aug 24 05:11:03.809511 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 626/1257] 10.222.0.105 () {58 vars in 1253 bytes} [Wed Aug 24 05:11:03 2022] DELETE /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:11:03.818075 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2df3d56c-38e0-44b7-97f3-6ad49395ade7 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde62bdf820>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.866631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2df3d56c-38e0-44b7-97f3-6ad49395ade7 tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 200 len: 353 microversion: 2.1 time: 0.052674 Aug 24 05:11:03.867237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 632/1258] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:04.881203 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d4c83beb-0f87-413b-afba-6d998456772c tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Calling method '.version_select at 0x7fde5e49dca0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:04.913113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-d4c83beb-0f87-413b-afba-6d998456772c tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] HTTP exception thrown: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d4c83beb-0f87-413b-afba-6d998456772c tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Request method failure captured: Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e HTTP/1.1 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbLjzZ2n9qTRQGJsmr3tG7i6IcAJKfNOHMmBELuOrvzzc-oweEE-m4kJcxKR0_iTXmRcx6CqEQEe69gnlUNKFueC0dI-8213ug5pLIml_bbviLMUc3B9ozgHyEAM5N_0fF9_PEOlG7OExe1WyZBT8r13T5OhXJBA2DeRonofLJJqigc Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: abd030a80a194419a3766a2924cf1139 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-VolumesGetTestJSON-567582469 Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:11:04.915120 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/abd030a80a194419a3766a2924cf1139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_abd030a80a194419a3766a2924cf1139", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/abd030a80a194419a3766a2924cf1139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/abd030a80a194419a3766a2924cf1139"}]}] Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-VolumesGetTestJSON-567582469 Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: abd030a80a194419a3766a2924cf1139 Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-VolumesGetTestJSON-567582469 Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-VolumesGetTestJSON-567582469-project Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 8ce18713b2ed4b7ead32aec832eff5ba Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-VolumesGetTestJSON-567582469-project Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'c63f4777-e59e-4319-8caf-27d4ac7f315e'} Aug 24 05:11:04.916832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. (HTTP 404) (Request-ID: req-155dee5d-7ba9-4d95-ab1e-9cdbc4f27649) Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:04.917872 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:11:04.919339 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:11:04.920723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d4c83beb-0f87-413b-afba-6d998456772c tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] Returning 404 to user: Volume c63f4777-e59e-4319-8caf-27d4ac7f315e could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d4c83beb-0f87-413b-afba-6d998456772c tempest-VolumesGetTestJSON-567582469 tempest-VolumesGetTestJSON-567582469-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e" status: 404 len: 109 microversion: 2.1 time: 0.040619 Aug 24 05:11:04.922208 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 627/1259] 10.222.0.105 () {58 vars in 1250 bytes} [Wed Aug 24 05:11:04 2022] GET /compute/v2.1/os-volumes/c63f4777-e59e-4319-8caf-27d4ac7f315e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:11:19.897387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:11:19.898752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:11:44.035222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.037580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.044899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.045466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.045974 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.046743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.047302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.047798 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.078469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2809f4ae-9aae-499b-811b-c5f2b288063a tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050289 Aug 24 05:11:44.083155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 633/1260] 10.222.0.105 () {60 vars in 1348 bytes} [Wed Aug 24 05:11:44 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:11:44.148759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.149408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.156096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.156575 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.157009 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.157714 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.158171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.158591 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.187486 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:11:44.539073 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3890f2fa-7340-4f12-beda-2a3be85b41a5 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 204 len: 0 microversion: 2.20 time: 0.394826 Aug 24 05:11:44.546169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 628/1261] 10.222.0.105 () {60 vars in 1285 bytes} [Wed Aug 24 05:11:44 2022] DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:11:44.556522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.557306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.564357 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.564848 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.565365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.566154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.566684 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.567237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.705844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:44.716854 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:44.718583 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:44.720620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1df0086c-37f4-4ed3-a9ef-fe30525ad138 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.168118 Aug 24 05:11:44.720620 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 634/1262] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:44 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:11:45.747654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.748477 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.756038 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.756628 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.762394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.762394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.762394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.762394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.968375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:45.976904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:45.978415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:45.979916 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-4a1afe6f-125d-4a82-bf71-f47e9d92e47c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.239113 Aug 24 05:11:45.980499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 629/1263] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:45 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:11:47.002791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:47.003744 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:47.010606 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.011111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.011587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.012899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.013359 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.013781 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.166540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:47.178239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:47.180972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:47.182650 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-63de5635-5afe-4357-b615-9198326a9d32 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1727 microversion: 2.20 time: 0.183776 Aug 24 05:11:47.183547 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 635/1264] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:46 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:11:47.572237 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7559b8f3-b3b1-435b-9463-68acef1ab41e", "name": "network-vif-deleted", "tag": "9ab1453d-67b5-49c8-8f3c-ea71d32993d7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:47.585741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.587080 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.587763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.613219 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] Creating event network-vif-deleted:9ab1453d-67b5-49c8-8f3c-ea71d32993d7 for instance 7559b8f3-b3b1-435b-9463-68acef1ab41e on hv-cinder-85426 Aug 24 05:11:47.623978 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-c9d6c3d7-ec50-4b2f-b778-c97da0a70f79 req-7d7845c3-9ff2-4fd6-8f44-0af294072b72 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063239 Aug 24 05:11:47.625295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 630/1265] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:48.210129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:48.219497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:48.219497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.219497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.219497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.219936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.219936 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.220240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.253101 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.253580 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.254013 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.254462 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lazy-loading 'fault' on Instance uuid 7559b8f3-b3b1-435b-9463-68acef1ab41e {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:11:48.298028 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:48.306830 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:48.308597 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '842e7dea2bb24389b900d29351a0bd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373da7992054abfae0564708529a973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:48.310279 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c19213bc-b494-4bcb-b47d-a531063daefc tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 200 len: 1374 microversion: 2.20 time: 0.104244 Aug 24 05:11:48.311250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 636/1266] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:48 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 1374 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:11:49.335156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.335848 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:49.343283 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.346670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.346670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.346670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.346670 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.347137 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.360704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e HTTP/1.1 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:11:49.362555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:49.364415 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '7559b8f3-b3b1-435b-9463-68acef1ab41e'} Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:49.365251 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:49.366600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.367841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:49.367841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bd225457-2168-4936-9712-5449ae8d589f tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 404 len: 111 microversion: 2.20 time: 0.034014 Aug 24 05:11:49.367841 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 631/1267] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:49 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:11:49.373931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2a1ec366-80c4-4422-bc1f-741f0537233c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '.version_select at 0x7fde5e437820>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.506220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2a1ec366-80c4-4422-bc1f-741f0537233c tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705308472" status: 204 len: 0 microversion: 2.20 time: 0.136662 Aug 24 05:11:49.513049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 637/1268] 10.222.0.105 () {60 vars in 1264 bytes} [Wed Aug 24 05:11:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705308472 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:11:52.220011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.220800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:52.227304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.227890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.228381 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.229098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.229549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.229968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.245779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e HTTP/1.1 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:11:52.247819 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.249299 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '7559b8f3-b3b1-435b-9463-68acef1ab41e'} Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:52.250090 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.251533 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.253341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:52.253341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d6fcb25d-d04d-4199-b31a-a154bef29c33 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 404 len: 111 microversion: 2.20 time: 0.033290 Aug 24 05:11:52.253341 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 632/1269] 10.222.0.105 () {60 vars in 1285 bytes} [Wed Aug 24 05:11:52 2022] DELETE /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:11:52.259545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.260208 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: 7559b8f3-b3b1-435b-9463-68acef1ab41e] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:52.269876 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.270383 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.271159 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.272151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.272765 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.273198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.289428 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e HTTP/1.1 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:11:52.291303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.293563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '7559b8f3-b3b1-435b-9463-68acef1ab41e'} Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:52.294925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. Aug 24 05:11:52.296603 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:52.297901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance 7559b8f3-b3b1-435b-9463-68acef1ab41e could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:52.297901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ae4323e-98ff-429b-9548-b086a38b6476 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e" status: 404 len: 111 microversion: 2.20 time: 0.038718 Aug 24 05:11:52.297901 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 638/1270] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:52 2022] GET /compute/v2.1/servers/7559b8f3-b3b1-435b-9463-68acef1ab41e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:11:53.621941 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:53.622759 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:53.629220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.629734 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.630181 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.630930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.631382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.631821 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.648387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc HTTP/1.1 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:11:53.650068 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.651904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'ff4d90aa-1f68-4002-962b-207093b0e8dc'} Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:53.652899 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.654382 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.658600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:53.658600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d903d2d5-7fa3-47f7-ad4b-fcbad31eb3d3 tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 404 len: 111 microversion: 2.20 time: 0.034189 Aug 24 05:11:53.658600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 633/1271] 10.222.0.105 () {60 vars in 1285 bytes} [Wed Aug 24 05:11:53 2022] DELETE /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:11:53.660742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:53.661482 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] [instance: ff4d90aa-1f68-4002-962b-207093b0e8dc] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:53.669119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.669607 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.670038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.670837 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.671356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.671778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.687317 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] HTTP exception thrown: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Request method failure captured: Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc HTTP/1.1 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbA3lDpztdVEQb5tkoJYcZOA0O3uUo8aMNioDUtLWDzMe5Z5TjRgxFpOr06fayA2fl-bLj4CHzA4LDcDOfgn3fMHA8HOSY7EBDc5ThOD_8R6w9-aMk-6c-8T9UgdZ6LsQkKmJuwMNp2TN2pulFxFfe1n5VFvwGWJYG2gRbwqX9HuKlw Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:11:53.690155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d373da7992054abfae0564708529a973", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d373da7992054abfae0564708529a973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d373da7992054abfae0564708529a973"}]}] Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: d373da7992054abfae0564708529a973 Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-415363385 Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 842e7dea2bb24389b900d29351a0bd33 Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-415363385-project Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.692025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'ff4d90aa-1f68-4002-962b-207093b0e8dc'} Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:53.692842 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. Aug 24 05:11:53.694092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:11:53.695363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] Returning 404 to user: Instance ff4d90aa-1f68-4002-962b-207093b0e8dc could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:53.695363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2358d160-ed1d-45ad-b6b5-89bd96ee36ee tempest-AttachVolumeShelveTestJSON-415363385 tempest-AttachVolumeShelveTestJSON-415363385-project] 10.222.0.105 "GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc" status: 404 len: 111 microversion: 2.20 time: 0.035353 Aug 24 05:11:53.695363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 639/1272] 10.222.0.105 () {60 vars in 1282 bytes} [Wed Aug 24 05:11:53 2022] GET /compute/v2.1/servers/ff4d90aa-1f68-4002-962b-207093b0e8dc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:12:13.550338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:12:13.552588 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:13.555257 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:13.555921 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:13.560556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.561087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.561525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.562236 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.562667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.563118 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.823516 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a32c1c20-085c-41cb-8bb0-50bcbc5df210 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action" status: 202 len: 0 microversion: 2.1 time: 0.276879 Aug 24 05:12:13.826423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 634/1273] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:12:13 2022] POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:12:13.836293 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:13.836687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:13.839219 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:13.839873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=30 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:13.844965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.845443 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.848316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.848316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.848316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.848316 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.051085 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:14.058534 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-00c70c0a-fc36-4114-a9cf-6f3a72abd21b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1755 microversion: 2.1 time: 0.226365 Aug 24 05:12:14.059179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 640/1274] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:13 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:15.082800 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:15.083540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:15.090113 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.090598 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.091054 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.091754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.092903 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.093305 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.251225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:15.259601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e9155938-630c-48bb-bb95-32c7e901f57c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.181850 Aug 24 05:12:15.260158 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 635/1275] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:15 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:16.285471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:16.286354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:16.295408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.295900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.296344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.297045 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.297499 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.297963 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.452869 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:16.461249 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7fd88b70-0e01-4ccd-829e-58237bd0747f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.182854 Aug 24 05:12:16.461878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 641/1276] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:16 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:17.483555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:17.484099 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:17.490880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.491115 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.491603 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.492307 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.492765 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.493200 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.646930 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:17.655592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0918ceda-d92a-4b00-a85a-82398a2cd13c tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.176086 Aug 24 05:12:17.656467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 636/1277] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:17 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:18.677905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:18.678451 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:18.685410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.686479 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.687246 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.687888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.688615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.688899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.846736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:18.855562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-842444cd-f2ca-49b9-b485-f275f9f6c72d tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.181630 Aug 24 05:12:18.856143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 642/1278] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:18 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:19.876832 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:19.877447 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:19.884400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.884878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.885456 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.886192 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.886702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.887220 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.044504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:20.054565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-b07d0146-9225-4f8a-b79c-1df07054b931 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.182337 Aug 24 05:12:20.055176 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 637/1279] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:19 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:21.077300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:21.077989 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:21.084387 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.084875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.085320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.086055 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.086515 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.086945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.240729 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:21.249797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2a25f61e-98de-4222-b26c-c0a7e4486063 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.176911 Aug 24 05:12:21.254420 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 643/1280] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:21 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:22.271629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:22.272239 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:22.278777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.279300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.279738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.280443 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.280971 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.281398 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.428338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:22.437950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9dcfcdda-d7f8-4e6b-95b1-635fa80436b6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.169990 Aug 24 05:12:22.438720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 638/1281] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:22 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:23.460746 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:23.461306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:23.467665 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.468155 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.469131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.469835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.470312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.470739 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.624385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:23.633204 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f3eee8f7-0d7b-43c9-a463-55685f6799ef tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.176764 Aug 24 05:12:23.633783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 644/1282] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:23 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:24.655005 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:24.655642 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:24.663252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.663745 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.664184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.664956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.665408 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.665833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.814545 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:24.822830 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f2e72d82-dada-4081-9208-e500e78e29bb tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.171758 Aug 24 05:12:24.823435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 639/1283] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:24 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:25.845715 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:25.846505 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:25.853681 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.854206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.854635 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.855553 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.856099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.856521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:26.017780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:26.026351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-208cf354-4646-4deb-83d0-01658b1cf591 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.185371 Aug 24 05:12:26.026932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 645/1284] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:25 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:27.049620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:27.050774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:27.058493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.058952 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.059404 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.060098 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.060543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.061295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.212607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:27.222627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3b99ce14-a28f-4449-a281-c2e47f99511e tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.178113 Aug 24 05:12:27.224564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 640/1285] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:27 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:28.244833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:28.245527 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:28.253356 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.253984 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.254342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.255132 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.255595 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.256030 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.413444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:28.421943 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cacf8e09-5b89-4698-8a14-b1446f7fab19 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.180941 Aug 24 05:12:28.422516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 646/1286] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:28 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:29.444754 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:29.445312 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:29.452178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.452388 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.452824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.453531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.453993 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.454423 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.607496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:29.616945 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-04c21aa4-46fd-4d3e-9b4b-802b92bfc74a tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.176081 Aug 24 05:12:29.617612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 641/1287] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:29 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:30.649694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:30.649694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:30.649694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.649694 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.650575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.650575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.650575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.650575 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.810226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:30.819775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-65dd4904-c0c9-4e3f-aab0-506bc0cebe68 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1760 microversion: 2.1 time: 0.185842 Aug 24 05:12:30.820398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 647/1288] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:30 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:12:31.840635 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:31.841334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:31.848320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.855131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.855131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.855131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.855131 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.855574 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.008887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:32.019452 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-dfbafe28-0ab8-4c19-ad4c-51d7d3320ac1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1763 microversion: 2.1 time: 0.182600 Aug 24 05:12:32.020044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 642/1289] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:12:31 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1763 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:58.537045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:12:58.537766 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:13:18.906099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:13:18.906794 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:13:42.622679 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=16 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:42.623817 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=48 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:42.805932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e11dd2c2-9e76-490c-b9a2-1275fd6148f8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Action: 'create', calling method: .version_select at 0x7fde5e1e2ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-708958801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3cefE0VjsdJN9dSk7evLn2fJ0Rvi/GOc5fRu/wKXVrWRTK7ztK3V3G5RmnAmKbACOE5kUWAQBgFqbTHoHVPrAI0wtKoLuPOtg4nrevAckcpyKU4Sb/vwJhrWTXnLEtZA=="}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:42.825240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-e11dd2c2-9e76-490c-b9a2-1275fd6148f8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for project 2a010cb56074448a979b3b7d944a92d6. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:13:42.829821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-e11dd2c2-9e76-490c-b9a2-1275fd6148f8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for user 11c7bb2f319e4bd2a7e03a4f77d29c4f and project 2a010cb56074448a979b3b7d944a92d6. Resources: {'key_pairs'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:13:42.909361 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e11dd2c2-9e76-490c-b9a2-1275fd6148f8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.288395 Aug 24 05:13:42.910023 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 648/1290] 10.222.0.105 () {60 vars in 1164 bytes} [Wed Aug 24 05:13:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:55.948612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=18 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:55.952249 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:55.953772 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-917840049"}} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:55.954321 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:55.961407 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.961870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.966498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.966498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.966498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.966498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.121621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.network.security_group_api [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Removing security group 6c1d6530-abe6-4e74-9cb9-e5b7b79c1682 from port 99121297-4f7c-4781-a86a-671bcdda3a4e Aug 24 05:13:56.615723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-65dee101-8ac5-4ab3-9bc3-09b34fd81ea1 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action" status: 202 len: 0 microversion: 2.1 time: 0.668733 Aug 24 05:13:56.617289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 643/1291] 10.222.0.105 () {60 vars in 1283 bytes} [Wed Aug 24 05:13:55 2022] POST /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:13:56.625836 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b73c3c52-89b6-42db-9d8c-7dd8cdf35c9f] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:13:56.626656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=4 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:56.627813 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:56.633061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:56.651090 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.651645 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.652320 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.665986 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] Creating event network-changed:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:13:56.674073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-4f6dc0e1-74f1-44f2-91f5-1f067275e2f3 req-7b6d48ce-b1e5-4f5f-95e3-32c9c3280a01 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050101 Aug 24 05:13:56.674692 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 649/1292] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:58.051229 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:58.052061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:58.061007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.061823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.062556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.063760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.064536 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.065207 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.199961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lazy-loading 'services' on Instance uuid c5717edf-8fe2-4dff-8443-50f04684fddb {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:13:58.485763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-535bd824-0590-4bf4-af11-9473499ef097 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments/f465c014-7152-4a4e-b58e-f17b8a3d5630" status: 202 len: 0 microversion: 2.1 time: 0.439122 Aug 24 05:13:58.486357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 644/1293] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:13:58 2022] DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments/f465c014-7152-4a4e-b58e-f17b8a3d5630 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:13:58.507980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:58.514735 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:58.527816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b73c3c52-89b6-42db-9d8c-7dd8cdf35c9f] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42238. Aug 24 05:13:58.533365 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.533864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.534385 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.535146 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.535742 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.536345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.581469 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a1e07ee6-65fa-4c8c-b896-37a4bdce7d85 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081720 Aug 24 05:13:58.582253 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 650/1294] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:13:58 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:58.700060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:58.711392 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.711890 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.712330 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.725649 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] Creating event network-changed:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:13:58.736174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-abb7bd0e-4fda-451a-bf21-aefc19ca3d28 req-fc358452-cab1-4ca3-9dd2-22b339e66a14 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040169 Aug 24 05:13:58.737590 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 645/1295] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:59.598408 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:59.602168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:59.610004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.610506 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.610947 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.611700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.612160 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.612588 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.646868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-60a81d31-3e91-4cdc-abde-0a4e52542c83 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053192 Aug 24 05:13:59.647533 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 651/1296] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:13:59 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:00.662084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:00.665156 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:00.673647 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.674196 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.674659 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.675592 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.676363 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.677262 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.713688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-cdfd56dc-9998-4f33-a5db-d5a6eaecbf1b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057645 Aug 24 05:14:00.714274 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 646/1297] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:14:00 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:01.726882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:01.729068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:01.735576 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.736061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.736496 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.737191 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.737642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.738067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.768453 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-60c97c0f-2f34-4ad5-94a0-9b3ff192bae2 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Aug 24 05:14:01.769017 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 652/1298] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:14:01 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:02.781022 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:02.783293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:02.790355 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.790824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.791281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.791969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.792418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.792833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.823278 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8256d7f9-8dca-4840-8571-f9bf52876005 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Aug 24 05:14:02.823833 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 647/1299] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:14:02 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:03.837800 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:03.839950 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:03.846266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.846743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.847200 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.847886 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.848330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.849283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.878315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-51978c8e-0b86-4f61-9dc7-80e265bdb246 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 24 05:14:03.878864 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 653/1300] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:14:03 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:04.891275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:04.893650 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:04.900394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.900883 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.901319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.902214 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.902695 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.903123 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.938522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-90d8f89b-7566-44b1-a872-b7ce4a8c0146 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051337 Aug 24 05:14:04.939074 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 648/1301] 10.222.0.105 () {58 vars in 1307 bytes} [Wed Aug 24 05:14:04 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:14:04.950302 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:04.950840 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:04.957631 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.958117 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.958784 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.959322 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.959778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.960193 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.040226 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] HTTP exception thrown: Instance c5717edf-8fe2-4dff-8443-50f04684fddb is not attached to volume f465c014-7152-4a4e-b58e-f17b8a3d5630 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Request method failure captured: Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments/f465c014-7152-4a4e-b58e-f17b8a3d5630 HTTP/1.1 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbJ-WqEhwPWeryUmGxsowK6dGLT_o4bt0EN0GAy1CQjqml7JrGhQ2gisbLfI2Pvqymjfmfash_-5GfCMRr0_S37aa0eQZr5RM95D0zevWM85HeQFwo9P4u07rKrKI9Y25-zWN8XuqdwEy7PpC4Ld9ym4CPxNZeoahn3ikl3r1zXQkds Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 67112706d4df4183bc338732b237df6e Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:14:05.042625 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/67112706d4df4183bc338732b237df6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_67112706d4df4183bc338732b237df6e", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/67112706d4df4183bc338732b237df6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/67112706d4df4183bc338732b237df6e"}]}] Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 67112706d4df4183bc338732b237df6e Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-TestMinimumBasicScenario-1662056506-project Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: dfc1475f560d4151a0c569433544f36a Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-TestMinimumBasicScenario-1662056506-project Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:14:05.044323 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance c5717edf-8fe2-4dff-8443-50f04684fddb is not attached to volume f465c014-7152-4a4e-b58e-f17b8a3d5630 Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'server_id': 'c5717edf-8fe2-4dff-8443-50f04684fddb', 'id': 'f465c014-7152-4a4e-b58e-f17b8a3d5630'} Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f465c014-7152-4a4e-b58e-f17b8a3d5630. Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:14:05.045142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5717edf-8fe2-4dff-8443-50f04684fddb is not attached to volume f465c014-7152-4a4e-b58e-f17b8a3d5630 Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5717edf-8fe2-4dff-8443-50f04684fddb is not attached to volume f465c014-7152-4a4e-b58e-f17b8a3d5630 Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:05.046851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Returning 404 to user: Instance c5717edf-8fe2-4dff-8443-50f04684fddb is not attached to volume f465c014-7152-4a4e-b58e-f17b8a3d5630 {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:14:05.048216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3ff08fa-a7ef-4961-ad59-d375ade96d2b tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments/f465c014-7152-4a4e-b58e-f17b8a3d5630" status: 404 len: 154 microversion: 2.1 time: 0.097937 Aug 24 05:14:05.048216 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 654/1302] 10.222.0.105 () {58 vars in 1421 bytes} [Wed Aug 24 05:14:04 2022] DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb/os-volume_attachments/f465c014-7152-4a4e-b58e-f17b8a3d5630 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:14:06.350752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:06.351298 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:06.357696 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.358171 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.358602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.359311 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.359760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.360741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.398133 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:14:06.720126 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-53f49f66-8612-4bc5-8822-9e69189aba96 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 204 len: 0 microversion: 2.1 time: 0.373244 Aug 24 05:14:06.720718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 649/1303] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:14:06 2022] DELETE /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:14:06.730161 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:06.730909 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:06.737653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.738237 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.738695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.740108 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.741077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.741513 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.886428 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:06.894474 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-45ae96b8-f210-4b49-8c1b-b5c2705cb203 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1558 microversion: 2.1 time: 0.168507 Aug 24 05:14:06.895066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 655/1304] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:06 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:07.917923 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:07.918623 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:07.925106 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.925617 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.926055 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.926758 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.927302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.927732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.060042 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:08.068514 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-17dad1b8-a5b2-4be6-86e1-b0e45105c2ff tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1558 microversion: 2.1 time: 0.154806 Aug 24 05:14:08.069189 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 650/1305] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:07 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:08.927900 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-740926355", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-708958801", "security_groups": [{"name": "tempest-secgroup-smoke-73242212"}], "block_device_mapping_v2": [{"uuid": "fa99231e-50f3-4fbb-b760-eff18de1a19e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e39c69d4-f995-4cc8-81d2-c9d8d589bafb"}]}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:09.051994 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] validate_networks() for [('e39c69d4-f995-4cc8-81d2-c9d8d589bafb', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:14:09.089927 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:09.090630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:09.097968 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.099630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.099630 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.100441 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.100972 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.101741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.302049 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:09.310469 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-6ac42625-c30b-4620-81c5-4c1923545e30 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1558 microversion: 2.1 time: 0.224418 Aug 24 05:14:09.324446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 651/1306] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:09 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:09.557465 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5717edf-8fe2-4dff-8443-50f04684fddb", "name": "network-vif-deleted", "tag": "99121297-4f7c-4781-a86a-671bcdda3a4e"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:09.571466 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.573494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.573494 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.584610 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] Creating event network-vif-deleted:99121297-4f7c-4781-a86a-671bcdda3a4e for instance c5717edf-8fe2-4dff-8443-50f04684fddb on hv-cinder-85426 Aug 24 05:14:09.589538 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-3b774a97-6f6f-4abc-8495-07df5b2f4a11 req-bad14f11-85e2-4000-bdee-ef1217c1a204 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Aug 24 05:14:09.590143 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 652/1307] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:09.629091 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:14:09.629708 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:14:09.630906 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:14:09.631472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:14:09.632092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:14:09.642379 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.642896 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.644403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.644403 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.644736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.645053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.664011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:14:09.668197 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for user 11c7bb2f319e4bd2a7e03a4f77d29c4f and project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:14:09.736321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:14:09.736321 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa99231e-50f3-4fbb-b760-eff18de1a19e',volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:14:10.272856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f5bf1f3d-f1d6-4135-9b0c-963a4d3af586 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.349671 Aug 24 05:14:10.273795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 656/1308] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:14:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:14:10.287525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c05ed624-d8bb-40de-a208-ba76335ad06e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:10.288885 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c05ed624-d8bb-40de-a208-ba76335ad06e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:10.333259 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:10.334168 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:10.340795 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.341430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.342540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.342852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.343347 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.343778 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.344704 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c05ed624-d8bb-40de-a208-ba76335ad06e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:10.353020 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c05ed624-d8bb-40de-a208-ba76335ad06e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1096 microversion: 2.1 time: 0.070424 Aug 24 05:14:10.353782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 653/1309] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:10 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:10.381522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.382007 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.382448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.382913 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lazy-loading 'fault' on Instance uuid c5717edf-8fe2-4dff-8443-50f04684fddb {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:14:10.428789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc1475f560d4151a0c569433544f36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67112706d4df4183bc338732b237df6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:10.437491 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-2ec3e407-cbd1-4bc7-aa19-6b452f302df6 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 200 len: 1352 microversion: 2.1 time: 0.108333 Aug 24 05:14:10.438021 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 657/1310] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:10 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:11.375342 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a9eeaab4-950e-45f3-b8e4-1a038995c119 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.376245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a9eeaab4-950e-45f3-b8e4-1a038995c119 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:11.435509 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a9eeaab4-950e-45f3-b8e4-1a038995c119 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:11.442729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a9eeaab4-950e-45f3-b8e4-1a038995c119 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1096 microversion: 2.1 time: 0.071243 Aug 24 05:14:11.443653 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 654/1311] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:11 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:11.458997 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.459924 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] [instance: c5717edf-8fe2-4dff-8443-50f04684fddb] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:11.466284 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.466764 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.467233 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.467927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.468378 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.468802 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.483380 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] HTTP exception thrown: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Request method failure captured: Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb HTTP/1.1 Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbJ-WqEhwPWeryUmGxsowK6dGLT_o4bt0EN0GAy1CQjqml7JrGhQ2gisbLfI2Pvqymjfmfash_-5GfCMRr0_S37aa0eQZr5RM95D0zevWM85HeQFwo9P4u07rKrKI9Y25-zWN8XuqdwEy7PpC4Ld9ym4CPxNZeoahn3ikl3r1zXQkds Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 67112706d4df4183bc338732b237df6e Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:14:11.484923 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/67112706d4df4183bc338732b237df6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_67112706d4df4183bc338732b237df6e", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/67112706d4df4183bc338732b237df6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/67112706d4df4183bc338732b237df6e"}]}] Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 67112706d4df4183bc338732b237df6e Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1662056506 Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-TestMinimumBasicScenario-1662056506-project Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: dfc1475f560d4151a0c569433544f36a Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-TestMinimumBasicScenario-1662056506-project Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. Aug 24 05:14:11.486683 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': 'c5717edf-8fe2-4dff-8443-50f04684fddb'} Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:14:11.487856 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. Aug 24 05:14:11.489590 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:14:11.491240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Returning 404 to user: Instance c5717edf-8fe2-4dff-8443-50f04684fddb could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:14:11.491240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5e63527e-cd62-477c-befa-e2365e57206f tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb" status: 404 len: 111 microversion: 2.1 time: 0.031940 Aug 24 05:14:11.491240 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 658/1312] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:11 2022] GET /compute/v2.1/servers/c5717edf-8fe2-4dff-8443-50f04684fddb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:14:11.495296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bc5ddc01-9879-437e-ac2e-96c7725b7085 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] Calling method '.version_select at 0x7fde5e1b04c0>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.566905 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bc5ddc01-9879-437e-ac2e-96c7725b7085 tempest-TestMinimumBasicScenario-1662056506 tempest-TestMinimumBasicScenario-1662056506-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1611935646" status: 202 len: 0 microversion: 2.1 time: 0.075255 Aug 24 05:14:11.567750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 655/1313] 10.222.0.105 () {58 vars in 1277 bytes} [Wed Aug 24 05:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1611935646 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:14:12.462743 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-34463746-e770-4294-a5b6-0f7171885cf5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:12.463375 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-34463746-e770-4294-a5b6-0f7171885cf5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:12.517015 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-34463746-e770-4294-a5b6-0f7171885cf5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:12.525582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-34463746-e770-4294-a5b6-0f7171885cf5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1096 microversion: 2.1 time: 0.066583 Aug 24 05:14:12.526162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 659/1314] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:12 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1096 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:13.546226 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-2eafe946-6889-461a-8552-1d2bdbffee66 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:13.547065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-2eafe946-6889-461a-8552-1d2bdbffee66 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:13.601146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-2eafe946-6889-461a-8552-1d2bdbffee66 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:13.608667 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-2eafe946-6889-461a-8552-1d2bdbffee66 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1096 microversion: 2.1 time: 0.066780 Aug 24 05:14:13.609245 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 656/1315] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:13 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1096 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:14.630926 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:14.632690 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:14.657992 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.658726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.659201 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.660190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.660841 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.661512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.732818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:14.745239 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e396ef0d-944f-4140-b7d9-a4afe602f7b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1146 microversion: 2.1 time: 0.118678 Aug 24 05:14:14.746016 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 660/1316] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:14 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1146 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:15.768760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:15.773802 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:15.777954 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.778539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.779215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.779938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.780435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.780862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.870024 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:15.882739 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5f7bb569-6f66-4da2-96e0-85f9127980e6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1146 microversion: 2.1 time: 0.117432 Aug 24 05:14:15.882739 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 657/1317] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:15 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1146 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:16.907141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:16.907929 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:16.915456 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.916264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.916887 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:16.917843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.918300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.918728 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.002816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:17.012891 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e1480646-d668-4671-b774-69bbe0c6c009 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1202 microversion: 2.1 time: 0.110145 Aug 24 05:14:17.013518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 661/1318] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:16 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:18.036981 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:18.037845 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:18.044884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.045365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.045798 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.046498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.047228 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.047818 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.122459 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:18.131777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e0eaa6f3-3afb-40c6-9274-520cecfb3971 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1212 microversion: 2.1 time: 0.099523 Aug 24 05:14:18.132365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 658/1319] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:18 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:19.156972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:19.157877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:19.165345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.165825 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.166255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.166945 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.167435 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.167853 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.319186 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:19.327543 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-798e3cfc-2393-42c4-b7c6-a314cb853587 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.174794 Aug 24 05:14:19.334107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 662/1320] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:19 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:20.093934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb04b3b-67ff-425a-af08-adf98da4e2f7", "tag": "44e72eb5-3b68-4e09-96cf-a03bb07e71c7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:20.111358 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.112070 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.112372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.124777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] Creating event network-changed:44e72eb5-3b68-4e09-96cf-a03bb07e71c7 for instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 on hv-cinder-85426 Aug 24 05:14:20.132449 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-50c8ab01-3ea7-4de4-b882-450948e08424 req-b3139ab9-2cbb-44a8-b424-d745cec4d0c6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042208 Aug 24 05:14:20.133387 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 659/1321] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:20.351655 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:20.352618 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:20.354684 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:20.360577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.364250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.364250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.364250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.364250 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.364780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.538522 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:20.546709 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-97db4184-1f29-4e17-97da-b850cc4ad0a4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.199856 Aug 24 05:14:20.547344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 663/1322] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:20 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:21.570050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:21.570742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:21.577549 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.578050 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.578489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.579394 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.579862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.580319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.800320 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:21.809581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-907c1148-269d-4247-85f5-9ea9153b57ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.244319 Aug 24 05:14:21.810157 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 660/1323] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:21 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:22.830109 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:22.832094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:22.833053 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=8 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:22.838452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.838943 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.839430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.840162 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.840634 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.841056 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.046388 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:23.055930 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-7ad8f4f3-6391-4383-8e5a-528b5bcabab7 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.229877 Aug 24 05:14:23.056563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 664/1324] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:22 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:24.077540 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:24.078282 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:24.080889 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=6 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:24.087182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.087673 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.090735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.090735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.090735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.090735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.246669 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:24.257686 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-5f39447e-49c8-4b38-bcb8-10668d85c444 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.183632 Aug 24 05:14:24.258612 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 661/1325] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:24 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:25.288657 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:25.289261 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:25.295868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.296344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.296773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.297461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.297911 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.298328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.450932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:25.464401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-cb56fd45-a4ec-46b3-868a-3a0ce6f6ba69 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.176665 Aug 24 05:14:25.464401 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 665/1326] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:25 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:26.481682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:26.482619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:26.485043 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:26.490843 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.491580 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.492011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.492864 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.493316 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.493741 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.496595 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:26.637910 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:26.646400 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-e452fbfe-1978-4411-bb80-9e7408d00d1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.169274 Aug 24 05:14:26.646974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 662/1327] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:26 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:27.667687 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:27.668303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:27.674852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.675888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.675888 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.676477 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.676927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.677381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.680199 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=87 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:27.811732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:27.820265 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4e15a359-9e0f-4b36-b282-317892d880ed tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.156464 Aug 24 05:14:27.820843 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 666/1328] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:27 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:28.841875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:28.842586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:28.851007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.851504 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.851940 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.852638 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.853085 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.853501 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.997823 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:29.006160 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9ba7e764-4854-4522-9ec6-b547b05c2c81 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.168409 Aug 24 05:14:29.006735 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 663/1329] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:28 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:30.027185 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:30.027797 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:30.029637 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:30.035151 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.035641 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.036139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.036846 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.038598 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.039248 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.180143 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:30.187723 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-a1dc6e05-3bc7-4571-8c60-3aaf5258d727 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.164836 Aug 24 05:14:30.188296 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 667/1330] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:30 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:31.209247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:31.209938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:31.220450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.220450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.220450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.220450 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.221121 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.221121 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.378787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:31.388375 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-243d8989-a43b-43d1-9735-a1cdc8713697 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.182993 Aug 24 05:14:31.388961 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 664/1331] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:31 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:32.413815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:32.413815 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:32.417058 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.417544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.417976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.418835 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.419382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.419820 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.565639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:32.575278 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-82cfe35c-f982-4779-b3e7-32ccada314d6 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.169464 Aug 24 05:14:32.575862 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 668/1332] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:32 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:33.234026 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb04b3b-67ff-425a-af08-adf98da4e2f7", "name": "network-vif-plugged", "status": "completed", "tag": "44e72eb5-3b68-4e09-96cf-a03bb07e71c7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:33.244186 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.244791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.245225 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.256215 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] Creating event network-vif-plugged:44e72eb5-3b68-4e09-96cf-a03bb07e71c7 for instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 on hv-cinder-85426 Aug 24 05:14:33.261805 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-2e307712-6d4c-4be2-8c0e-3063e7a6f368 req-93bd8ec0-ea1e-40ac-8a2b-195482c2607b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Aug 24 05:14:33.262481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 665/1333] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:33.597613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:33.598461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:33.605898 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.606582 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.607153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.607877 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.608333 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.608757 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.747651 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:33.755330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-04c02618-9c23-4b90-ba39-22372dc8126d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.161849 Aug 24 05:14:33.755904 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 669/1334] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:33 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:34.784760 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:34.785463 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:34.792673 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.793168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.793605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.794317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.794775 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.795240 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.940855 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:34.949168 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-3d7edb88-3c2f-4fc9-84cc-51c6b556357f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1266 microversion: 2.1 time: 0.168542 Aug 24 05:14:34.949752 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 666/1335] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:34 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:35.969818 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:35.970430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:35.977178 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.977672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.978225 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.979153 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.979604 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.980029 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.121577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:36.129728 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-0670d27d-ec52-4e00-beb6-82939897ea9b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1453 microversion: 2.1 time: 0.163738 Aug 24 05:14:36.130301 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 670/1336] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:35 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:14:36.151197 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:36.151809 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:36.158155 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.158627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.159087 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.159771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.160218 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.160637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.299254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:36.307654 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-06481c44-7c89-4506-b189-e38b4a9ffee8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1453 microversion: 2.1 time: 0.160592 Aug 24 05:14:36.308212 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 667/1337] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:14:36 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:38.475500 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb04b3b-67ff-425a-af08-adf98da4e2f7", "tag": "44e72eb5-3b68-4e09-96cf-a03bb07e71c7"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:38.486922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.486922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.486922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.499615 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] Creating event network-changed:44e72eb5-3b68-4e09-96cf-a03bb07e71c7 for instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 on hv-cinder-85426 Aug 24 05:14:38.506492 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-dff38a80-f4fe-4453-ab16-49e31306834b req-d279bde4-d102-47f7-846c-d35936a5de1b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034558 Aug 24 05:14:38.507256 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 671/1338] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:16.077686 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:16.078423 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:18.545639 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:18.546322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:19.909382 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:19.909995 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:54.398292 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:16:54.398975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=11 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:54.399755 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=31 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:54.403884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:54.404383 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:54.410290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.414535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.414535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.414535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.414535 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.415103 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.440455 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:16:54.743124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-43eda1ef-53c3-4968-97bd-9a26d8e950a2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 204 len: 0 microversion: 2.1 time: 0.347500 Aug 24 05:16:54.743725 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 668/1339] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:16:54 2022] DELETE /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:16:54.754073 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b73c3c52-89b6-42db-9d8c-7dd8cdf35c9f] AMQP server on 10.222.0.105:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:16:54.754775 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=9 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:54.758976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=31 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:54.763512 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:54.764210 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:54.770150 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.770632 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.771142 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.771838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.772294 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.772819 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.910927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:54.918702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-b3f60c06-6403-4c6e-a347-a35821b6f878 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1576 microversion: 2.1 time: 0.166513 Aug 24 05:16:54.919285 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 672/1340] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:16:54 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:55.940934 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:55.941631 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:55.949694 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.950184 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.950620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.951354 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.951837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.952260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.971030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42540. Aug 24 05:16:56.102193 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:56.115446 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-71b7752b-225d-4860-9ebc-647be207bf0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1576 microversion: 2.1 time: 0.178505 Aug 24 05:16:56.116030 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 669/1341] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:16:55 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:57.139260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:57.139928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:57.148511 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:57.149370 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:57.150088 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:57.151393 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:57.151910 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:57.152402 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:57.173381 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b73c3c52-89b6-42db-9d8c-7dd8cdf35c9f] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42544. Aug 24 05:16:57.299609 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:57.329714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-96e7a0eb-8834-4c31-9196-cfc6c517cb2a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1576 microversion: 2.1 time: 0.173798 Aug 24 05:16:57.329714 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 673/1342] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:16:57 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:57.761483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb04b3b-67ff-425a-af08-adf98da4e2f7", "name": "network-vif-deleted", "tag": "44e72eb5-3b68-4e09-96cf-a03bb07e71c7"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:57.778522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:57.779343 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:57.779518 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:57.793153 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] Creating event network-vif-deleted:44e72eb5-3b68-4e09-96cf-a03bb07e71c7 for instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 on hv-cinder-85426 Aug 24 05:16:57.797828 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-9da3b834-d67b-4f35-9fcb-0ed1e3b64a8f req-16c90c0e-545c-4c5b-b156-01331cb19a19 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210955 Aug 24 05:16:57.798751 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 670/1343] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:58.331413 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:58.332014 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:58.339398 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:58.339873 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:58.340306 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.340982 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:58.341432 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:58.341851 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.375636 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:58.376125 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:58.376564 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.377013 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lazy-loading 'fault' on Instance uuid 3fb04b3b-67ff-425a-af08-adf98da4e2f7 {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:16:58.420049 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:58.429012 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-75be8f43-94f9-459d-be0f-e84ce03c019f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 200 len: 1232 microversion: 2.1 time: 0.101396 Aug 24 05:16:58.429861 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 674/1344] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:16:58 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 1232 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:59.453051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:59.453682 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:59.460957 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.461430 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.461958 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.462543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.462990 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.463433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.480247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] HTTP exception thrown: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Request method failure captured: Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 HTTP/1.1 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbN_7_0q5hgQRajSoUYRhWJmA50g_HbfnB-aurnVcRVoAG8hr7w4hm1MwdcQo_bl_NOC6mbTN9zCb8f47TA-MKkVSYqN0DoDj4NxZF0UlZtwMdCZOvyvPvRlTEVheA4-SCyG01C9plt5XAeN6i6ErQ0SNck0CA-SxBF6ALk7Q-XRv2g Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:16:59.481896 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a010cb56074448a979b3b7d944a92d6", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}] Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 11c7bb2f319e4bd2a7e03a4f77d29c4f Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:16:59.483865 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '3fb04b3b-67ff-425a-af08-adf98da4e2f7'} Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:16:59.485061 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:16:59.486795 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:16:59.488433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Returning 404 to user: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:16:59.488433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0eaaec26-ba70-4eda-9a29-70909b9d2bf3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 404 len: 111 microversion: 2.1 time: 0.035023 Aug 24 05:16:59.488433 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 671/1345] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:16:59 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:16:59.583727 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-519958309", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-708958801", "security_groups": [{"name": "tempest-secgroup-smoke-73242212"}], "block_device_mapping_v2": [{"uuid": "fa99231e-50f3-4fbb-b760-eff18de1a19e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e39c69d4-f995-4cc8-81d2-c9d8d589bafb"}]}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:59.707431 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] validate_networks() for [('e39c69d4-f995-4cc8-81d2-c9d8d589bafb', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:17:00.093955 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:17:00.094377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:17:00.094852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:17:00.095287 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:17:00.095699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:17:00.110074 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.110552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.110980 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.111728 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.112180 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.112601 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.130230 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:17:00.134478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for user 11c7bb2f319e4bd2a7e03a4f77d29c4f and project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:17:00.193300 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:17:00.195461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa99231e-50f3-4fbb-b760-eff18de1a19e',volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:17:00.591774 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-504f7040-0b40-458c-aa5d-d590a2f3022c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013139 Aug 24 05:17:00.592736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 675/1346] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:16:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:17:00.605567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-241408b8-c6bc-4076-a317-663b8c90f973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:00.606453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-241408b8-c6bc-4076-a317-663b8c90f973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:00.675891 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-241408b8-c6bc-4076-a317-663b8c90f973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:00.687380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-241408b8-c6bc-4076-a317-663b8c90f973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1096 microversion: 2.1 time: 0.083114 Aug 24 05:17:00.687380 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 672/1347] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:00 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1096 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:01.711528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:01.712122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:01.718122 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.718608 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.719067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.719769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.720223 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.720647 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.787222 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:01.795594 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-29decd49-e3a5-4217-831f-00ca1b0b08b0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1146 microversion: 2.1 time: 0.088988 Aug 24 05:17:01.796330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 676/1348] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:01 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:02.818391 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:02.819992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:02.827678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.828169 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.828607 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.829318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.829777 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.830254 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.894931 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:02.907290 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-de44c673-e6a9-4b92-9d44-c1aaa267782c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1212 microversion: 2.1 time: 0.093635 Aug 24 05:17:02.907882 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 673/1349] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:02 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:03.929852 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:03.930460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:03.936738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.937220 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.937654 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:03.938446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.938894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.939346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:04.074478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:04.082780 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4e49715f-1e4e-4b45-bcb1-61a5b59a1f91 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.156906 Aug 24 05:17:04.083372 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 677/1350] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:03 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:04.160525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78416bb6-70a9-4cc4-8fcf-be17610b8675", "tag": "e2b0de18-360a-469c-aa02-1d83145b657b"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:17:04.170750 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:04.171253 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:04.171677 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:04.183875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] Creating event network-changed:e2b0de18-360a-469c-aa02-1d83145b657b for instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 on hv-cinder-85426 Aug 24 05:17:04.189252 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-a42a725c-1d1a-4843-ad74-1043af7c0d54 req-8631e419-f1e0-4303-9a5f-d5ffd9fdc16f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033028 Aug 24 05:17:04.191403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 674/1351] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:17:05.103756 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:05.104351 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:05.110669 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.111190 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.111621 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.112315 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.112905 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.113528 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.254338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:05.264663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-564236db-85ae-4a16-a4e2-f21bfe3a0e36 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.164464 Aug 24 05:17:05.265516 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 678/1352] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:05 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:06.286859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:06.287478 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:06.293789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:06.294273 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:06.294720 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:06.295451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:06.295911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:06.296338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:06.434317 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:06.443581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-efdb1464-2e19-48a1-8ebb-4ac9323fcd61 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.161160 Aug 24 05:17:06.450519 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 675/1353] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:06 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:07.464878 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:07.465446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:07.472040 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:07.472530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:07.472970 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:07.473672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:07.474129 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:07.474558 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:07.614444 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:07.622227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-51c82fb0-673d-4bed-9da0-7bfd881cfd43 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.161280 Aug 24 05:17:07.622804 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 679/1354] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:07 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:08.643660 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:08.644409 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:08.650880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:08.651385 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:08.651813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:08.652501 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:08.652950 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:08.653366 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:08.800829 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:08.812318 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-561293fe-a8a3-44e3-85ea-2bb104f7c213 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.172640 Aug 24 05:17:08.812904 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 676/1355] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:08 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:09.834577 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:09.835164 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:09.841859 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:09.842338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:09.842768 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:09.843490 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:09.843937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:09.844353 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:09.994966 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:10.003066 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-feb8a08e-0bcb-4e61-8a47-323e08a3d7b4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.173629 Aug 24 05:17:10.003656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 680/1356] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:09 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:11.024738 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:11.025288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:11.027700 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=2 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:11.032476 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:11.032955 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:11.033489 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:11.034331 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:11.034787 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:11.035272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:11.165285 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:11.172964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9ace1b10-4719-41f0-8b15-69ca70fd7a68 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.152146 Aug 24 05:17:11.173534 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 677/1357] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:11 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:12.193928 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:12.194544 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:12.196405 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:12.197187 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=6 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:12.202179 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:12.202653 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:12.203107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:12.203789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:12.204235 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:12.205141 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:12.336789 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:12.344537 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ae49dce6-8788-481d-aea3-ef8af5fd9151 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.154422 Aug 24 05:17:12.345099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 681/1358] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:12 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:13.365661 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:13.366276 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:13.372792 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:13.373272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:13.373710 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:13.374395 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:13.374846 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:13.375297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:13.509969 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:13.519091 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-acdfe28a-5f77-441f-889a-f037896ef8a5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.157259 Aug 24 05:17:13.519663 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 678/1359] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:13 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:14.540232 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:14.540838 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:14.547342 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:14.547821 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:14.548871 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:14.549639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:14.550114 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:14.550535 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:14.689291 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:14.697206 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-52999284-1cab-4498-90db-5d598e15d594 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.160898 Aug 24 05:17:14.700738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 682/1360] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:14 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:15.718611 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:15.719248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:15.725637 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:15.726112 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:15.726544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:15.727269 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:15.727723 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:15.730678 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:15.872364 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:15.881315 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-d2a8ef28-4b28-4e42-aebc-1b4f7c9d35aa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.166580 Aug 24 05:17:15.881893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 679/1361] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:15 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:16.076419 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78416bb6-70a9-4cc4-8fcf-be17610b8675", "name": "network-vif-plugged", "status": "completed", "tag": "e2b0de18-360a-469c-aa02-1d83145b657b"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:17:16.085932 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:16.086565 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:16.087008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:16.098613 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] Creating event network-vif-plugged:e2b0de18-360a-469c-aa02-1d83145b657b for instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 on hv-cinder-85426 Aug 24 05:17:16.103952 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-fd653eeb-e6de-4374-8326-8e66c01fea26 req-db494829-8f1a-4f84-bbd0-61b83f99b4f1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089869 Aug 24 05:17:16.104779 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 683/1362] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:17:16.901277 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:16.901887 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:16.909053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:16.909562 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:16.909998 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:16.910688 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:16.911180 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:16.911602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:17.040096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:17.048439 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-34c7e1af-9a66-4cde-8f82-88f23e8ad82a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.150379 Aug 24 05:17:17.049011 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 680/1363] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:16 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:18.070530 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:18.071368 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:18.077377 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:18.077855 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:18.078293 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:18.079243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:18.079673 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:18.080098 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:18.216214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:18.225063 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-f5e27ba9-6e6a-4b5c-abb2-c24903de647a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1266 microversion: 2.1 time: 0.159189 Aug 24 05:17:18.225674 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 684/1364] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:18 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:19.246794 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:19.247453 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:19.254297 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.254782 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.255248 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.255938 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.256396 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.256824 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.390124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:19.396880 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c39efab2-1015-4e44-91ee-b29427750d3b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1454 microversion: 2.1 time: 0.153987 Aug 24 05:17:19.397435 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 681/1365] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:19 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:19.417449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:19.418062 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:19.425532 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.426011 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.426478 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.427214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.427672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.428099 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.559345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:19.567754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-14e0f121-a5f9-4ca8-a474-d2b467a56c73 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1454 microversion: 2.1 time: 0.154146 Aug 24 05:17:19.568726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 685/1366] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:17:19 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:21.556467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78416bb6-70a9-4cc4-8fcf-be17610b8675", "tag": "e2b0de18-360a-469c-aa02-1d83145b657b"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:17:21.566372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:21.566852 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:21.567314 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:21.578992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] Creating event network-changed:e2b0de18-360a-469c-aa02-1d83145b657b for instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 on hv-cinder-85426 Aug 24 05:17:21.585857 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-1d8fdabd-0dce-4feb-905f-f0fe64e0f16e req-64e5a18f-ecaa-4646-a9b8-e7bebcb2fa0c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093640 Aug 24 05:17:21.586493 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 682/1367] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:19:23.050569 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.051345 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=78 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:23.055596 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1281165947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-708958801", "security_groups": [{"name": "tempest-secgroup-smoke-73242212"}], "block_device_mapping_v2": [{"uuid": "b8c71369-d041-48b8-b12d-65a9412a62ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e39c69d4-f995-4cc8-81d2-c9d8d589bafb"}]}} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:19:23.259972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.network.neutron [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] validate_networks() for [('e39c69d4-f995-4cc8-81d2-c9d8d589bafb', None, None, None, None, None)] {{(pid=122276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:19:23.710068 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:19:23.710525 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image limits 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:19:23.711004 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Flavor pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:19:23.711446 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Image pref 0:0:0 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:19:23.711872 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.virt.hardware [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:19:23.721139 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:23.721617 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:23.722050 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:23.722769 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:23.723274 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:23.723806 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:23.742810 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:19:23.747119 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.quota [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Getting quotas for user 11c7bb2f319e4bd2a7e03a4f77d29c4f and project 2a010cb56074448a979b3b7d944a92d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:19:23.804695 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Going to run 1 instances... {{(pid=122276) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:19:23.806817 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8c71369-d041-48b8-b12d-65a9412a62ab',volume_size=None,volume_type=None)] {{(pid=122276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:19:24.144518 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [0bb4cc23-1c32-42ad-91c7-64aad59f8d2e] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:19:25.151752 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [0bb4cc23-1c32-42ad-91c7-64aad59f8d2e] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42720. Aug 24 05:19:25.156430 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ea50fb62-57b4-4024-ab7d-843674e34a1c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.108183 Aug 24 05:19:25.157107 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 686/1368] 10.222.0.105 () {60 vars in 1152 bytes} [Wed Aug 24 05:19:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 05:19:25.166111 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] AMQP server on 10.222.0.105:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:19:25.166789 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.167522 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:25.173356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-49e5d3d2-1714-41c0-adb4-ac803e824ac4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:25.173356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-49e5d3d2-1714-41c0-adb4-ac803e824ac4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:25.286646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-49e5d3d2-1714-41c0-adb4-ac803e824ac4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:25.293451 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-49e5d3d2-1714-41c0-adb4-ac803e824ac4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1097 microversion: 2.1 time: 0.129333 Aug 24 05:19:25.294000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 683/1369] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:25 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1097 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:26.314672 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-3e065889-ab9b-4011-ae2c-aa0078cd7e2d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:26.315340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-3e065889-ab9b-4011-ae2c-aa0078cd7e2d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:26.596092 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-3e065889-ab9b-4011-ae2c-aa0078cd7e2d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:26.602880 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-3e065889-ab9b-4011-ae2c-aa0078cd7e2d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1097 microversion: 2.1 time: 0.293003 Aug 24 05:19:26.603489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 687/1370] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:26 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1097 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:27.624102 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0fd33691-672b-4818-85fc-f4ce3d1ef7d0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:27.625224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0fd33691-672b-4818-85fc-f4ce3d1ef7d0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:27.649551 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42746. Aug 24 05:19:27.681956 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-0fd33691-672b-4818-85fc-f4ce3d1ef7d0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:27.689556 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0fd33691-672b-4818-85fc-f4ce3d1ef7d0 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1097 microversion: 2.1 time: 0.069967 Aug 24 05:19:27.690149 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 684/1371] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:27 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1097 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:28.710642 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4edc7151-07d9-4df8-8b57-85c6c28436cd tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:28.711309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4edc7151-07d9-4df8-8b57-85c6c28436cd tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:28.763467 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4edc7151-07d9-4df8-8b57-85c6c28436cd tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:28.772165 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4edc7151-07d9-4df8-8b57-85c6c28436cd tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1097 microversion: 2.1 time: 0.065749 Aug 24 05:19:28.772736 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 688/1372] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:28 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1097 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:29.793567 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:29.794260 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:29.800895 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:29.803621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:29.803621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:29.803621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:29.803621 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:29.804015 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:29.865834 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:29.874879 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-c16bb0e7-3147-48ad-b350-2fff7a43c49f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1147 microversion: 2.1 time: 0.084861 Aug 24 05:19:29.875619 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 685/1373] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:29 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:30.756616 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:30.756893 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:30.896084 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:30.896700 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:30.903283 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:30.903833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:30.904328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:30.905325 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:30.905868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:30.906915 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:30.979935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:30.989484 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-47a7196b-b8a4-4773-a973-28bbfdf56eb3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1203 microversion: 2.1 time: 0.097841 Aug 24 05:19:30.990483 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 689/1374] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:30 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1203 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:32.012289 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:32.013028 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:32.019779 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:32.020372 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:32.020928 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:32.021860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:32.022326 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:32.022748 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:32.162531 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:32.170965 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-1faf330d-507b-4dfb-8c21-e4364eef4478 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1279 microversion: 2.1 time: 0.162958 Aug 24 05:19:32.171568 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 686/1375] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:32 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:32.493098 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a", "tag": "3f30116c-ea93-4f8c-ad4e-0897eec2827f"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:19:32.502894 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:32.503466 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:32.505865 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:32.514846 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] Creating event network-changed:3f30116c-ea93-4f8c-ad4e-0897eec2827f for instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a on hv-cinder-85426 Aug 24 05:19:32.519312 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR oslo.messaging._drivers.impl_rabbit [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] [5033f92f-fa1d-4ccb-8b7b-ec17872fa2b5] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:19:33.192582 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:33.193773 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:33.199646 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:33.200065 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:33.200495 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:33.201178 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:33.201625 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:33.202045 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:33.338293 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:33.346424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a54f791a-5997-477b-b125-bdf29603e96c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.157977 Aug 24 05:19:33.346975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 687/1376] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:33 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:33.525791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] [5033f92f-fa1d-4ccb-8b7b-ec17872fa2b5] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42768. Aug 24 05:19:33.529257 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-eb8272f6-8952-4133-b9c3-316da47cd4cb req-c256e039-5060-48fd-bde3-644e0b5fb28f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.040066 Aug 24 05:19:33.530154 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 690/1377] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:19:34.367345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:34.367992 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:34.374583 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:34.375401 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:34.375909 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:34.376601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:34.377053 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:34.377467 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:34.509304 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:34.517813 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ac0f064e-3c65-4f17-b38f-b34178fdcfe3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.154211 Aug 24 05:19:34.518581 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 688/1378] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:34 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:35.537489 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=2 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.542008 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:35.542925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:35.549067 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:35.553025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:35.553025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:35.553025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:35.553025 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:35.553413 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:35.681369 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:35.689192 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-4a615dfc-bef8-4c40-a68b-7382e4775c5d tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.152761 Aug 24 05:19:35.689776 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 691/1379] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:35 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:36.086461 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:36.086639 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:36.709064 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:36.709680 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:36.716351 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:36.716837 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:36.717322 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:36.718012 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:36.718996 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:36.719537 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:36.851300 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:36.859894 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-cee26a3e-9f24-475c-9fa2-20f6a6c43487 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.153894 Aug 24 05:19:36.860464 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 689/1380] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:36 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:37.881399 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:37.882022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:37.888439 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:37.888957 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:37.889392 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:37.890111 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:37.890587 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:37.891243 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:38.022319 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:38.030545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-1ada9835-b5f9-4c37-b72f-a809b76c4e9e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.152987 Aug 24 05:19:38.032801 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 692/1381] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:37 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:38.554709 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:38.555334 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:39.050962 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:39.051605 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:39.053461 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell0:SELECT=4 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.058629 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:39.059146 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:39.059586 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:39.060272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:39.060729 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:39.061295 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:39.200110 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:39.208357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-8d2a9a2d-5c03-415f-a805-3a3d98eb8efa tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.161621 Aug 24 05:19:39.208925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 690/1382] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:39 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:40.229309 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:40.229844 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:40.231702 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell0:SELECT=10 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:40.237480 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:40.247691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:40.247691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:40.247691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:40.247691 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:40.248131 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:40.371890 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:40.380245 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ee33adf9-3727-43a3-97b5-3fc856e063d8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.154813 Aug 24 05:19:40.380809 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 693/1383] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:40 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:41.400911 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:41.401513 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:41.408785 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:41.409272 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:41.409717 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:41.410418 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:41.410875 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:41.411338 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:41.547340 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:41.554964 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f2ec4dd3-1dcc-42cc-9612-48f093d391a3 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.157917 Aug 24 05:19:41.555555 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 691/1384] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:41 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:42.575931 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:42.576563 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:42.583374 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:42.583849 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:42.584276 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:42.584965 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:42.585418 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:42.586471 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:42.721773 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:42.730941 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-00bde223-cc25-49c9-839c-d53f4d11ca3f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.158858 Aug 24 05:19:42.731663 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 694/1385] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:42 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:43.754606 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:43.755247 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:43.762060 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:43.762539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:43.762976 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:43.763701 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:43.764159 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:43.764585 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:43.893497 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:43.901121 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-48ee71b3-7f8d-4b0c-921f-9c2a8ce5c628 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.151589 Aug 24 05:19:43.901685 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 692/1386] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:43 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:44.706130 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a", "name": "network-vif-plugged", "status": "completed", "tag": "3f30116c-ea93-4f8c-ad4e-0897eec2827f"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:19:44.716266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:44.716741 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:44.717169 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:44.729102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] Creating event network-vif-plugged:3f30116c-ea93-4f8c-ad4e-0897eec2827f for instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a on hv-cinder-85426 Aug 24 05:19:44.734586 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-b65f2c14-fb5e-478d-8c07-7f20219be7af req-1d1296c2-8816-46bc-a5e5-a796b85f59f2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Aug 24 05:19:44.735330 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 695/1387] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:19:44.922281 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:44.923007 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:44.931210 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:44.934799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:44.934799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:44.934799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:44.934799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:44.935271 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:45.075768 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:45.083838 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-9cca6877-c942-4b06-bbe2-c468346885d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.165813 Aug 24 05:19:45.084705 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 693/1388] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:44 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:46.106255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:46.106944 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:46.113993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:46.114486 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:46.114925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:46.115657 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:46.116113 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:46.116545 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:46.252047 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:46.260448 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-e0f26583-2466-4323-a4f7-e7a63240d5b2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1267 microversion: 2.1 time: 0.158890 Aug 24 05:19:46.261009 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 696/1389] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:46 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:47.281953 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:47.282796 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:47.290172 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.290676 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.291127 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:47.291827 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.292302 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.292727 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:47.440105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:47.448924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fd92b73c-5fc3-4444-b702-50afcd5d0a8c tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1454 microversion: 2.1 time: 0.171092 Aug 24 05:19:47.449599 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 694/1390] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:47 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:47.469976 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:47.470579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:47.477845 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.478344 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.478754 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:47.479472 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.479935 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.480358 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:47.617022 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:47.624791 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-c2115433-e7a3-490d-a01c-95ae3aa47815 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1454 microversion: 2.1 time: 0.158596 Aug 24 05:19:47.625353 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 697/1391] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:19:47 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:49.674483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a", "tag": "3f30116c-ea93-4f8c-ad4e-0897eec2827f"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:19:49.689096 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:49.689791 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:49.690498 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:49.704114 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] Creating event network-changed:3f30116c-ea93-4f8c-ad4e-0897eec2827f for instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a on hv-cinder-85426 Aug 24 05:19:49.710520 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-760cd44c-a72b-45bb-9e3c-c63dffc91953 req-eaf4588d-4599-474d-a394-b3535f397ffd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Aug 24 05:19:49.716601 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 695/1392] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:21:50.323061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:50.323061 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG dbcounter [-] [122276] Writing DB stats nova_cell1:SELECT=48 {{(pid=122276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:50.325544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] AMQP server on 10.222.0.105:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:21:50.326174 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_api:SELECT=30 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:50.326779 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a", "tag": "3f30116c-ea93-4f8c-ad4e-0897eec2827f"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:21:50.327888 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG dbcounter [-] [122277] Writing DB stats nova_cell1:SELECT=62 {{(pid=122277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:50.333356 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:50.334308 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:50.337699 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.338181 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.338611 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.340924 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.341403 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.342129 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.342743 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.344124 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.344975 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.359167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] Creating event network-changed:3f30116c-ea93-4f8c-ad4e-0897eec2827f for instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a on hv-cinder-85426 Aug 24 05:21:50.365303 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-940bda15-079c-4326-9ed9-8cfa1cf3c7ea req-8a033b3b-e692-4599-93d6-45f48e0bc30e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044913 Aug 24 05:21:50.366701 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 698/1393] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:21:50.382384 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Going to try to terminate instance {{(pid=122277) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:21:50.672006 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-0a27c11d-9e6e-4b83-ae4f-8492f9a42c0b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 204 len: 0 microversion: 2.1 time: 0.351593 Aug 24 05:21:50.672600 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 696/1394] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:21:50 2022] DELETE /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:21:50.682707 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:50.683585 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:50.691288 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.691824 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.692264 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.693000 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.693454 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.693882 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.860497 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:50.869271 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-026e86de-88a5-47dd-9b07-31cec1c60cb5 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1578 microversion: 2.1 time: 0.191147 Aug 24 05:21:50.869868 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 699/1395] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:50 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:51.892365 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:51.893732 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:51.901764 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:51.902242 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:51.902684 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:51.903484 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:51.903939 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:51.904362 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:51.910594 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a10f15-e34a-4f7c-a4ad-88f81a823507] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 42864. Aug 24 05:21:52.041145 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:52.049373 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-bad06ae0-285c-4e96-bb9f-472999a3768b tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1578 microversion: 2.1 time: 0.161486 Aug 24 05:21:52.049946 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 697/1396] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:51 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:53.072038 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:53.072761 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:53.081589 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:53.082077 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:53.082521 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:53.083258 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:53.083720 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:53.084148 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:53.219198 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:53.228364 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-ab8cab4a-452f-4b02-8357-0950283d194f tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1578 microversion: 2.1 time: 0.160134 Aug 24 05:21:53.229026 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 700/1397] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:53 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:53.429481 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a", "name": "network-vif-deleted", "tag": "3f30116c-ea93-4f8c-ad4e-0897eec2827f"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:21:53.439719 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:53.440194 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:53.440622 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:53.451565 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] Creating event network-vif-deleted:3f30116c-ea93-4f8c-ad4e-0897eec2827f for instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a on hv-cinder-85426 Aug 24 05:21:53.457296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-72600ed8-4934-4ae8-ad06-b29b109a7366 req-836c6edd-55ec-463d-8f93-59ab655d3fb1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 Aug 24 05:21:53.460762 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 698/1398] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:21:54.250260 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:54.250875 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:54.257328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:54.257808 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:54.258241 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:54.258927 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:54.259410 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:54.259831 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:54.290449 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:54.290925 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:54.291390 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:54.291833 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.objects.instance [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lazy-loading 'fault' on Instance uuid a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a {{(pid=122276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:21:54.336579 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:54.345503 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-8ae666de-d365-4d01-be75-0f3a8e4d714a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 200 len: 1233 microversion: 2.1 time: 0.099406 Aug 24 05:21:54.346328 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 701/1399] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:54 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 1233 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:55.367884 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:55.368525 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:55.380424 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:55.380907 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:55.381345 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:55.382041 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:55.382496 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:55.382974 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:55.396564 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] HTTP exception thrown: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Request method failure captured: Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a HTTP/1.1 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbN_7_0q5hgQRajSoUYRhWJmA50g_HbfnB-aurnVcRVoAG8hr7w4hm1MwdcQo_bl_NOC6mbTN9zCb8f47TA-MKkVSYqN0DoDj4NxZF0UlZtwMdCZOvyvPvRlTEVheA4-SCyG01C9plt5XAeN6i6ErQ0SNck0CA-SxBF6ALk7Q-XRv2g Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:21:55.398175 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a010cb56074448a979b3b7d944a92d6", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}] Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 11c7bb2f319e4bd2a7e03a4f77d29c4f Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. Aug 24 05:21:55.400051 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': 'a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a'} Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:21:55.401084 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. Aug 24 05:21:55.402854 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:21:55.404553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Returning 404 to user: Instance a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:21:55.404553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-a71ddc79-620e-49f8-b9da-0870a65cb3c8 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a" status: 404 len: 111 microversion: 2.1 time: 0.036271 Aug 24 05:21:55.404553 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 699/1400] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:55 2022] GET /compute/v2.1/servers/a1c1ad6e-0134-4110-96fe-ff7cfb2c6e8a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:21:58.941171 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:58.941823 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:58.944148 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78416bb6-70a9-4cc4-8fcf-be17610b8675", "tag": "e2b0de18-360a-469c-aa02-1d83145b657b"}]} {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:21:58.955224 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:58.955799 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:58.956470 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:58.958407 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:58.958937 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:58.959425 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:58.960133 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:58.962227 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:58.962562 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:58.969736 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.compute.server_external_events [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] Creating event network-changed:e2b0de18-360a-469c-aa02-1d83145b657b for instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 on hv-cinder-85426 Aug 24 05:21:58.975480 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [req-1d74da49-083f-4220-846a-a8b10067aebc req-fbbc0051-1ea0-47a6-9a12-fc993b597edf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036043 Aug 24 05:21:58.979715 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 700/1401] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:21:58.992452 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Going to try to terminate instance {{(pid=122276) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:21:59.317450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-fbf09e55-b734-4291-a335-d844731843d2 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "DELETE /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 204 len: 0 microversion: 2.1 time: 0.380577 Aug 24 05:21:59.318266 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 702/1402] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:21:58 2022] DELETE /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:21:59.327267 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:59.328001 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:59.335602 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:59.337211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:59.337211 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:59.338000 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:59.338627 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:59.339261 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:59.478763 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:59.487702 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-f4bbe1e9-8594-428c-9cd9-d3a1d6d35973 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1579 microversion: 2.1 time: 0.164563 Aug 24 05:21:59.488275 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 701/1403] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:21:59 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:00.509463 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:00.510156 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:00.517057 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:00.517540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:00.517972 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:00.518656 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:00.519386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:00.519812 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:00.654559 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.policy [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:00.662427 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-5636999b-6a4a-4cf7-80d5-14cba1c565f9 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1579 microversion: 2.1 time: 0.157322 Aug 24 05:22:00.662993 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 703/1404] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:22:00 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:01.684337 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:01.685182 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:01.692377 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:01.692862 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:01.693296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:01.693987 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:01.694439 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:01.694859 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:01.760046 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:01.766666 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78416bb6-70a9-4cc4-8fcf-be17610b8675", "name": "network-vif-deleted", "tag": "e2b0de18-360a-469c-aa02-1d83145b657b"}]} {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:01.769473 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ef6b4046-60e1-48f1-85e4-4a8d0acc47f4 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1394 microversion: 2.1 time: 0.088625 Aug 24 05:22:01.769912 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 702/1405] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:22:01 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1394 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:01.776828 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:01.777460 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:01.777899 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:01.789501 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.compute.server_external_events [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] Creating event network-vif-deleted:e2b0de18-360a-469c-aa02-1d83145b657b for instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 on hv-cinder-85426 Aug 24 05:22:01.794555 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [req-8053bbee-70e7-4cc2-8e99-ce8b1faa29db req-f71a5d0b-6e4e-4043-84cd-97eb7ef6fc0b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083797 Aug 24 05:22:01.795203 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 704/1406] 10.222.0.105 () {64 vars in 1322 bytes} [Wed Aug 24 05:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:22:02.789771 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:02.790503 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:02.797296 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:02.797860 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:02.798357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:02.799004 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:02.799483 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:02.799932 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:02.831499 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:02.831980 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:02.832419 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:02.832870 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.objects.instance [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lazy-loading 'fault' on Instance uuid 78416bb6-70a9-4cc4-8fcf-be17610b8675 {{(pid=122277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:22:02.873427 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.policy [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7bb2f319e4bd2a7e03a4f77d29c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a010cb56074448a979b3b7d944a92d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:02.881333 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-fe19f3ae-5ceb-425c-9a0f-0ba771d8739a tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 200 len: 1232 microversion: 2.1 time: 0.095442 Aug 24 05:22:02.881878 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 703/1407] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:22:02 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 1232 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:03.911570 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:03.912255 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 78416bb6-70a9-4cc4-8fcf-be17610b8675] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:03.918280 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:03.918753 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:03.919214 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:03.919891 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:03.920340 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:03.920816 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:03.935167 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] HTTP exception thrown: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Request method failure captured: Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 HTTP/1.1 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbN_7_0q5hgQRajSoUYRhWJmA50g_HbfnB-aurnVcRVoAG8hr7w4hm1MwdcQo_bl_NOC6mbTN9zCb8f47TA-MKkVSYqN0DoDj4NxZF0UlZtwMdCZOvyvPvRlTEVheA4-SCyG01C9plt5XAeN6i6ErQ0SNck0CA-SxBF6ALk7Q-XRv2g Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:22:03.936783 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a010cb56074448a979b3b7d944a92d6", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}] Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 11c7bb2f319e4bd2a7e03a4f77d29c4f Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. Aug 24 05:22:03.938633 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '78416bb6-70a9-4cc4-8fcf-be17610b8675'} Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:22:03.939881 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. Aug 24 05:22:03.941363 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:03.942710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Returning 404 to user: Instance 78416bb6-70a9-4cc4-8fcf-be17610b8675 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:22:03.942710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-81169139-8c74-471b-9621-cb8f0e211d40 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675" status: 404 len: 111 microversion: 2.1 time: 0.032648 Aug 24 05:22:03.942710 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 705/1408] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:22:03 2022] GET /compute/v2.1/servers/78416bb6-70a9-4cc4-8fcf-be17610b8675 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:22:04.426737 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:04.427319 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.compute.api [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122277) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:04.433624 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.434105 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.434539 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.435262 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.435718 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.436140 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG oslo_concurrency.lockutils [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.449288 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.wsgi [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] HTTP exception thrown: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Request method failure captured: Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: request: DELETE /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 HTTP/1.1 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept: application/json Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Accept-Encoding: identity Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Connection: close Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Length: 0 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Content-Type: application/json Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Host: 10.222.0.105 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Openstack-System-Scope: None Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: User-Agent: python-urllib3/1.26.11 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Auth-Token: gAAAAABjBbN_7_0q5hgQRajSoUYRhWJmA50g_HbfnB-aurnVcRVoAG8hr7w4hm1MwdcQo_bl_NOC6mbTN9zCb8f47TA-MKkVSYqN0DoDj4NxZF0UlZtwMdCZOvyvPvRlTEVheA4-SCyG01C9plt5XAeN6i6ErQ0SNck0CA-SxBF6ALk7Q-XRv2g Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Id: None Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Domain-Name: None Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Identity-Status: Confirmed Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Is-Admin-Project: True Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Id: default Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Domain-Name: Default Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Project-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Role: member,reader Aug 24 05:22:04.450869 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Roles: member,reader Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a010cb56074448a979b3b7d944a92d6", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}] Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Id: default Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Domain-Name: Default Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Id: 11c7bb2f319e4bd2a7e03a4f77d29c4f Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: X-User-Name: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: method: > Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: exception: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.452902 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: action_args: {'id': '3fb04b3b-67ff-425a-af08-adf98da4e2f7'} Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:22:04.453863 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.455742 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.457544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Returning 404 to user: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. {{(pid=122277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:22:04.457544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-ef490de2-251c-4cce-a2e9-2e4a5405abda tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 404 len: 111 microversion: 2.1 time: 0.029521 Aug 24 05:22:04.457544 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 704/1409] 10.222.0.105 () {58 vars in 1244 bytes} [Wed Aug 24 05:22:04 2022] DELETE /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:22:04.461450 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '>' {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:04.462064 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.compute.api [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] [instance: 3fb04b3b-67ff-425a-af08-adf98da4e2f7] Fetching instance by UUID {{(pid=122276) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:04.468094 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.469346 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.469918 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.470623 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Acquiring lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.471121 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.471552 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG oslo_concurrency.lockutils [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Lock "0413d8ab-f0c6-4531-9b34-84e3064b5ca2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.484941 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.wsgi [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] HTTP exception thrown: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Request method failure captured: Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: request: GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 HTTP/1.1 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept: application/json Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Accept-Encoding: identity Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Connection: close Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Length: 0 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Content-Type: application/json Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Host: 10.222.0.105 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Openstack-System-Scope: None Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: User-Agent: python-urllib3/1.26.11 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Auth-Token: gAAAAABjBbN_7_0q5hgQRajSoUYRhWJmA50g_HbfnB-aurnVcRVoAG8hr7w4hm1MwdcQo_bl_NOC6mbTN9zCb8f47TA-MKkVSYqN0DoDj4NxZF0UlZtwMdCZOvyvPvRlTEVheA4-SCyG01C9plt5XAeN6i6ErQ0SNck0CA-SxBF6ALk7Q-XRv2g Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Id: None Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Domain-Name: None Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Identity-Status: Confirmed Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Is-Admin-Project: True Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Id: default Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Domain-Name: Default Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Project-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Role: member,reader Aug 24 05:22:04.486540 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Roles: member,reader Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a010cb56074448a979b3b7d944a92d6", "adminURL": "http://10.222.0.105:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a010cb56074448a979b3b7d944a92d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a010cb56074448a979b3b7d944a92d6"}]}] Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Id: 2a010cb56074448a979b3b7d944a92d6 Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-Tenant-Name: tempest-TestVolumeBootPattern-1810561993 Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Id: default Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Domain-Name: Default Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Id: 11c7bb2f319e4bd2a7e03a4f77d29c4f Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: X-User-Name: tempest-TestVolumeBootPattern-1810561993-project Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: method: > Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: exception: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.488341 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: action_args: {'id': '3fb04b3b-67ff-425a-af08-adf98da4e2f7'} Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: {{(pid=122276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:22:04.489614 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. Aug 24 05:22:04.491360 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: ERROR nova.api.openstack.wsgi Aug 24 05:22:04.492922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: DEBUG nova.api.openstack.wsgi [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Returning 404 to user: Instance 3fb04b3b-67ff-425a-af08-adf98da4e2f7 could not be found. {{(pid=122276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:22:04.492922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO nova.api.openstack.requestlog [None req-bad174c7-d860-45fd-b7ee-9c83d75f36b1 tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7" status: 404 len: 111 microversion: 2.1 time: 0.030322 Aug 24 05:22:04.492922 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: [pid: 122276|app: 0|req: 706/1410] 10.222.0.105 () {58 vars in 1241 bytes} [Wed Aug 24 05:22:04 2022] GET /compute/v2.1/servers/3fb04b3b-67ff-425a-af08-adf98da4e2f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:22:06.053876 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: DEBUG nova.api.openstack.wsgi [None req-92c523f5-5bb8-4397-9f0c-c44d92fb116e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] Calling method '.version_select at 0x7fde5e1d8940>' {{(pid=122277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:06.141784 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO nova.api.openstack.requestlog [None req-92c523f5-5bb8-4397-9f0c-c44d92fb116e tempest-TestVolumeBootPattern-1810561993 tempest-TestVolumeBootPattern-1810561993-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-708958801" status: 202 len: 0 microversion: 2.1 time: 0.091809 Aug 24 05:22:06.142357 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: [pid: 122277|app: 0|req: 705/1411] 10.222.0.105 () {58 vars in 1265 bytes} [Wed Aug 24 05:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-708958801 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:22:56.095354 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:56.096102 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:22:58.563543 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:58.564165 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:24:30.766716 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:24:30.767620 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:24:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:24:39.923726 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:24:39.924338 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:24:55.555044 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:24:55.555609 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:24:58.923738 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:24:58.924386 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:16.104001 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:16.104732 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:18.572416 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:18.573023 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:27:50.775925 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:27:50.776774 dv-cinder-854265-1-iscsi devstack@n-api.service[122277]: Wed Aug 24 05:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:27:59.933646 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:27:59.934244 dv-cinder-854265-1-iscsi devstack@n-api.service[122276]: Wed Aug 24 05:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!